-- Logs begin at Thu 2022-07-21 05:49:20 UTC, end at Thu 2022-07-21 06:47:11 UTC. -- Jul 21 06:21:31.943427 dv-cinder-850318-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 06:21:31.953628 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 06:21:31.955639 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 06:21:31 2022] *** Jul 21 06:21:31.955639 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 06:21:31.955639 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 06:21:31.955639 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: nodename: dv-cinder-850318-3-iscsi Jul 21 06:21:31.955639 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: machine: x86_64 Jul 21 06:21:31.955639 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: clock source: unix Jul 21 06:21:31.955639 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: pcre jit disabled Jul 21 06:21:31.955639 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: detected number of CPU cores: 4 Jul 21 06:21:31.955639 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: current working directory: / Jul 21 06:21:31.955639 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: detected binary path: /usr/bin/uwsgi-core Jul 21 06:21:31.956287 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: your processes number limit is 47680 Jul 21 06:21:31.956287 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: your memory page size is 4096 bytes Jul 21 06:21:31.956287 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: detected max file descriptor number: 2048 Jul 21 06:21:31.956287 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: lock engine: pthread robust mutexes Jul 21 06:21:31.956287 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: thunder lock: enabled Jul 21 06:21:31.956287 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 06:21:31.956287 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 06:21:31.999561 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: Python main interpreter initialized at 0x55d8df8399c0 Jul 21 06:21:31.999561 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: python threads support enabled Jul 21 06:21:31.999561 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: your server socket listen backlog is limited to 100 connections Jul 21 06:21:31.999561 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: your mercy for graceful operations on workers is 90 seconds Jul 21 06:21:31.999900 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 06:21:31.999976 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: *** Operational MODE: preforking *** Jul 21 06:21:32.000214 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: *** uWSGI is running in multiple interpreter mode *** Jul 21 06:21:32.000214 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: spawned uWSGI master process (pid: 103128) Jul 21 06:21:32.000390 dv-cinder-850318-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 06:21:32.001758 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: spawned uWSGI worker 1 (pid: 103129, cores: 1) Jul 21 06:21:32.001758 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: spawned uWSGI worker 2 (pid: 103130, cores: 1) Jul 21 06:21:32.001758 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 06:21:32.660147 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 06:21:32.663637 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 06:21:33.785325 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 06:21:33.785325 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: from cryptography.utils import int_from_bytes Jul 21 06:21:33.786110 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 06:21:33.786110 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: from cryptography.utils import int_from_bytes Jul 21 06:21:33.792108 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 06:21:33.792108 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: from cryptography.utils import int_from_bytes Jul 21 06:21:33.792583 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 06:21:33.792583 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: from cryptography.utils import int_from_bytes Jul 21 06:21:36.255450 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 06:21:36.256027 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 06:21:36.256211 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 06:21:36.256570 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 06:21:36.257357 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 06:21:36.257742 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.258092 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.258414 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.258731 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.259056 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.259364 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.259683 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.259999 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.260322 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.260581 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.260693 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 06:21:36.261051 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.261136 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 06:21:36.261220 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850318-3-iscsi {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.261411 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 06:21:36.261516 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.261769 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 06:21:36.261857 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.262053 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 06:21:36.262143 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.262432 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.262541 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.262734 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.262821 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.263050 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.263141 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.263350 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.263442 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.263677 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.263858 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265043 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265043 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265248 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265248 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265400 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265487 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265567 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265567 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265725 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265800 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.265878 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.266007 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850318-3-iscsi {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.266091 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.266539 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.266626 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.266709 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.266783 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.266908 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.267010 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.267227 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.267351 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.267524 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.267637 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850318-3-iscsi {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.267838 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.267947 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.268134 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.268233 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.268541 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.268693 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.268923 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.269069 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.269204 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.269329 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.269511 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.269640 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.269832 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.269984 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.270166 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.270303 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.270471 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.270604 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.271033 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.271165 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.271337 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.271486 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.271689 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.271822 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.271948 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.272083 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.272252 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.273112 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850318-3-iscsi {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.273243 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.273396 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.273682 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.273821 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.273986 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.274131 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.274299 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.274446 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.274573 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.274724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.274860 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.275031 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.275161 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.275338 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.275469 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.275654 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.275782 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.275969 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.276114 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.276251 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.276378 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.276510 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.276636 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.276825 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.276962 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.277131 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.277259 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.277435 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.277582 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.277738 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.277889 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.278152 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.278288 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.278421 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.278556 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.278682 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.278814 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.278942 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.279073 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.279229 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.279358 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.279492 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.279619 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.279743 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.279874 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.280056 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.280185 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.280369 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.280506 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.280683 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.280816 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.280940 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.281119 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.281249 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.281383 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.281509 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.281663 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.281792 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.282023 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.282157 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.282341 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.282470 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.282639 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.282776 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.282939 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.283069 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.283237 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.283366 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.283535 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.283670 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.283834 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.283964 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.284138 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.284275 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.284447 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.284586 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.284755 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.284893 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.285061 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.285188 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.285313 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.285446 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.285579 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.285712 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.285898 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.286050 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.286218 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.286357 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.286522 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.286651 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.286825 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.286955 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.287127 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.287269 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.287426 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.287563 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.287731 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.287859 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.288164 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.288507 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.288611 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.288877 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.288975 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.289190 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.289307 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.289498 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.289606 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.289804 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.289900 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.290139 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.290252 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.290441 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.290529 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.290693 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.290781 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.290992 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.291089 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.291290 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.291380 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.291604 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.291691 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.291906 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.291996 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.292207 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.292311 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.292507 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.292595 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.292804 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.292906 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.293107 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.293205 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.293409 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.293505 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.293710 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.293810 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.294035 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.294127 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.294342 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.294430 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.294642 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.294731 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.294944 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.295030 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.295244 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.295330 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.295544 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.295632 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.295845 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.295930 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.296157 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.296262 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.296455 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.296550 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.296753 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.296840 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.297053 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.297138 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.297350 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.297447 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.297650 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.297742 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.297961 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.298074 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.298272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.298363 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.298584 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.298670 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.298882 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.298982 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.299181 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.299269 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.299493 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.299584 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.299794 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.299890 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.300093 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.300181 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.300395 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.300488 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.300689 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.300784 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.300989 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.301076 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.301300 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.301384 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.301601 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.301698 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.301902 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.302023 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.302239 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.302334 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.302540 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.302629 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.302838 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.302933 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.303136 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.303223 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.303433 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.304045 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.304542 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.304731 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.304864 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.305038 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.305179 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.305402 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.305505 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.305678 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.305799 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.306005 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.306143 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.306313 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.306479 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.306621 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.306799 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.306935 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:21:36.307117 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.307267 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.307433 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.307593 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.307746 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.307930 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.308061 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.308239 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.308387 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.308567 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.308707 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.308894 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.309003 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.309207 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.309344 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.309514 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.309684 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.309821 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.310022 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.310165 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.310347 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.310472 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.310665 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.310782 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.310977 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.311089 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.311286 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.311392 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.311600 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.311705 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.311921 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.312009 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.312252 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.312347 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.312563 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.312652 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.312878 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.312984 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.313188 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.313277 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.313497 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.313586 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.313805 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.313906 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.314141 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.314233 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.314444 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.314539 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.314778 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.314873 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.315093 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.315191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.315406 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.315496 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.315714 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.315801 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.316026 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.316127 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.316334 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.316422 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.316639 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.316734 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.316943 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.317044 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.317245 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.317332 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.317549 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.317637 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.317851 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.317970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.318186 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.318278 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.318490 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.318578 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.318793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.318893 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.319116 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.319822 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.319989 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.320325 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.320412 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.320631 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.320721 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.320946 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.321041 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.321258 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.321355 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.321570 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.321660 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.321875 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.321985 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.322218 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.322389 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.322532 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.322622 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.322835 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.322936 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.323159 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.323261 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.323457 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.323544 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.323756 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.323845 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.324057 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.324154 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.324364 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.324452 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.324661 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.324749 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.324975 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.325065 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.325285 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.325373 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.325585 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.325681 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.325894 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.326001 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.326225 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.326314 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.326533 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.326621 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.326840 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.326928 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.327143 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.327237 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.327442 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.327531 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.327748 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.327837 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.328053 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.328191 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.328354 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.328455 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.328671 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.328760 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.328979 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.329074 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.329279 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.329375 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.329586 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.329673 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.329884 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.330091 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.330208 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.330310 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.330509 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.330606 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.330816 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.330904 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.331115 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.331210 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.331418 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.331514 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.331722 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.331811 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.332025 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.332115 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.332324 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.332412 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.332629 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.332724 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.332938 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.333037 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.333240 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.333328 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.333539 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.333628 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.333839 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.333929 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.334200 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.334288 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.334503 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.334592 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.334831 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.334988 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.335190 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.335507 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.335607 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.335823 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.335921 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.336134 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.336223 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.336449 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.336544 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.336755 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.336844 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.337056 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.337144 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.337361 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.337450 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.337664 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.337760 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.337982 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.338074 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.338286 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.338440 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.338603 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.338699 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.338905 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.338993 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.339203 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.339308 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.339502 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.339591 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.339801 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.339927 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.340107 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.340202 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.340424 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.340514 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.340757 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.340845 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.341082 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.341193 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.341393 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.341482 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.341712 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.341838 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.342043 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.342153 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.342353 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.342441 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.342660 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.342746 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.342963 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.343051 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.343266 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.343364 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.343571 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.343658 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.343883 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.343971 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.344189 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.344278 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.344499 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.344588 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.344806 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.344895 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.345120 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.345222 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.345423 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.345511 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.345736 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.345823 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.346058 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.346150 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.346369 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.346457 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.346691 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.346787 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.347015 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.347103 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.347321 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.347415 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.347630 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.347718 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.347931 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.348017 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.348239 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.348335 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.348541 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.348634 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.348841 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.348975 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.349146 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.349243 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.349449 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.349538 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.349755 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.349842 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.350075 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.350182 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.350413 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.350512 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.350722 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.351022 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.351186 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.351337 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.351504 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.351642 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.351811 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.351941 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.352127 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.352217 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.352425 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.352513 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.352737 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.352832 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.353059 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.353157 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.353384 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.353472 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.353689 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.353777 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.354014 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.354108 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.354325 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.354421 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.354630 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.354717 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.354931 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.355026 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.355227 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.355315 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.355524 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.355619 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.355822 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.355910 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.356123 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.356211 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.356431 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.356527 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.356733 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.356828 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.357036 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.357133 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.357333 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.357429 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.357639 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.357728 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.357953 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.358043 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.358255 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.358355 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.358551 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.358695 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.358853 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.358986 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.359165 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.359254 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.359466 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.359553 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.359771 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.359864 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.360080 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.360169 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.360373 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.360460 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.360669 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.360757 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.360981 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.361071 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.361285 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.361374 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.361582 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.361671 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.361876 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.362053 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.362203 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.362291 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.362511 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.362618 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.362828 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.362917 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.363155 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.363394 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.363483 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.363724 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.363815 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.364038 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.364134 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.364356 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.364444 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.364659 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.364749 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.364961 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.365056 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.365272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.365361 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.365581 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.365670 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.365883 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.366540 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.366849 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.367168 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.367256 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.367480 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.367574 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.367783 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.367872 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.368096 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.368203 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.368401 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.368498 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.368708 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.368806 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.369011 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.369111 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.369314 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.369409 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.369617 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.369739 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.369921 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.370052 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.370248 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.370336 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.370553 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.370799 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.370888 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.371128 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.371224 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.371438 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.371528 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.371737 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.371837 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.372053 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.372179 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.372359 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.372446 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.372659 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.372761 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.372960 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.373048 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.373260 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.373349 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.373587 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.373684 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.373893 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.374003 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.374232 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.374321 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.374533 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.374621 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.374840 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.374930 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.375138 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.375226 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.375436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.375524 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.375733 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.375824 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.376038 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.376128 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.376334 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.376430 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.376631 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.376729 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.376928 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.377027 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.377225 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.377322 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.377521 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.377608 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.377815 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.377902 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.378144 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.378246 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.378438 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.378526 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.378743 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.378868 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.379043 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.379178 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.379337 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.379425 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.379632 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.379722 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.379928 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.380026 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.380235 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.380324 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.380535 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.380625 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.380835 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.380932 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.381142 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.381230 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.381446 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.381535 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.382304 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.382682 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.382782 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.383017 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.383106 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.383337 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.383435 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.383640 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.383730 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.383941 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.384029 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.384241 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.384329 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.384546 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.384634 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.384858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.384956 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.385156 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.385246 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.385460 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.385549 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.385764 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.385863 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.386091 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.386183 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.386393 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.386482 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.386686 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.386774 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.386988 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.387087 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.387281 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.387368 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.387587 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.387683 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.387887 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.387975 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.388185 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.388274 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.388480 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.388577 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.388784 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.388878 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.389084 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.389173 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.389378 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.389477 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.389675 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.389770 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.389987 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.390090 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.390292 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.390389 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.390588 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.390688 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.390885 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.390974 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.391182 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.391270 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.391480 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.391576 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.391780 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.391876 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.392075 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.392164 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.392373 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.392467 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.392672 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.392762 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.392965 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.393055 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.393262 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.393357 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.393564 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.393662 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.393860 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.393971 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.394176 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.394266 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.394486 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.394585 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.394802 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.394894 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.395111 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.395207 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.395408 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.395509 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.395708 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.396055 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.396256 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.396346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.396552 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.396656 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.396848 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.396937 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.397150 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.397264 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.399629 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.399734 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.399833 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.399922 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400004 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400082 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400161 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400249 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400338 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400419 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400498 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400577 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400664 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400745 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400829 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400910 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.400996 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401077 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401163 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401245 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401323 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401402 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401488 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401568 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401655 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401743 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401823 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.401902 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.402030 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.402200 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.402326 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.402514 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.402643 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.402818 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.402935 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.403121 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.403245 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.403428 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.403549 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.403762 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.403899 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.404034 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.404156 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.404335 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.404459 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.404646 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.404786 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.404950 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.405097 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.405232 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.405399 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.405547 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.405707 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.405850 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.406033 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.406177 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.406343 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.406490 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.406645 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.406804 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.407066 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.407155 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.407376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.407473 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.407689 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.407803 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.407996 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.408090 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.408301 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.408396 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.408602 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.408696 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.408905 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.409019 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.409209 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.409297 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.409511 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.409603 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.409811 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.409923 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.410140 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.410243 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.410444 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.410554 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.410740 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.410865 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.411043 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.411167 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.411347 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.411468 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.411643 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.411777 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.411958 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.412097 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.412263 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.412398 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.412560 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.412703 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.412864 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.413044 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.413538 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.413662 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.413846 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.413993 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.414196 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.414287 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.414612 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.414708 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.414930 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.415019 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.415235 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.415325 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.415579 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.415666 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.415885 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.415974 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.416190 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.416279 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.416498 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.416587 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.416809 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.416898 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.417107 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.417204 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.417454 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.417541 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.417767 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.417863 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.418101 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.418192 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.418410 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.418498 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.418708 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.418809 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.419005 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.419094 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.419309 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.419418 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.419620 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.419717 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.419917 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.420007 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.420212 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.420309 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.420508 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.420605 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.420821 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.420909 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.421120 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.421255 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.421433 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.421577 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.421839 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.421960 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.422169 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.422258 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.422467 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.422556 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.422825 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.422931 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.423128 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.423224 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.423440 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.423534 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.423742 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.423835 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.424045 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.424138 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.424363 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.424455 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.424661 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.424755 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.424967 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.425060 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.425273 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.425365 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.425584 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.425677 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.425886 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.426009 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.426212 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.426314 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.426521 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.426621 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.426820 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.426913 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.427134 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.427237 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.427445 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.427537 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.427755 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.427847 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.428072 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.428181 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.428373 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.428996 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.429382 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.429626 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.429766 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.429934 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.430091 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.430259 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.430412 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.430563 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.430735 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.430906 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.431040 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.431213 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.431341 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.431537 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.431636 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.431868 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.431960 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.432193 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.432282 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.432503 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.432599 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.432807 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.432910 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.433115 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.433225 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.433416 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.433523 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.433721 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.433812 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.434042 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.434147 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.434342 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.434440 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.434665 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.434753 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.434965 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.435060 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.435268 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.435357 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.435571 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.435662 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.435875 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.435963 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.436184 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.436275 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.436481 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.436575 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.436780 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.436870 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.437084 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.437181 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.437379 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.437475 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.437676 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.437772 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.437989 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.438081 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.438329 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.438426 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.438629 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.438730 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.438930 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.439019 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.439231 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.439321 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.439565 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.439663 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.439865 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.439998 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.440191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.440286 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.440502 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.440599 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.440811 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.440907 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.441122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.441211 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.441428 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.441524 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.441725 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.441813 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.442044 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.442137 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.442350 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.442449 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.442647 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.442736 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.442944 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.443032 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.443244 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.443346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.443546 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.443635 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.443841 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.443937 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.444181 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.444774 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.445020 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.445394 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.445483 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.445720 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.445812 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.446047 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.446281 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.446371 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.446615 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.446717 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.446934 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.447030 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.447239 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.447328 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.447537 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.447638 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.447851 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.447940 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.448164 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.448258 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.448475 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.448571 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.448786 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.448877 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.449097 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.449186 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.449408 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.449499 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.449711 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.449799 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.450057 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.450151 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.450370 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.450461 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.450679 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.450768 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.450988 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.451077 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.451298 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.451395 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.451605 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.451694 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.451912 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.452017 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.452220 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.452317 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.452526 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.452617 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.452835 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.453001 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.453144 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.453251 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.453457 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.453549 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.453772 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.453979 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.454115 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.454308 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.454424 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.454620 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.454743 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.454930 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.455054 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.455239 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.455365 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.455547 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.455676 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.455854 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.455988 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.456160 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.456300 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.456467 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.456622 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.456774 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.456957 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.457079 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.457278 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.457402 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.457590 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.457717 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.457903 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.458085 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.458243 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.458376 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.458685 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.458782 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.458994 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.459083 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.459303 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.459400 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.459616 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.459766 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.460101 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.460469 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.460632 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.460789 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.460878 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.461114 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.461211 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.461420 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.461517 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.461723 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.461819 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.462061 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.462156 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.462371 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.462469 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.462669 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.462763 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.462975 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.463064 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.463284 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.463381 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.463583 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.463673 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.463886 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.463981 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.464193 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.464283 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.464499 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.464728 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.464817 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.465071 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.465169 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.465385 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.465474 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.465708 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.465797 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.466047 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.466139 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.466360 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.466450 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.466663 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.466869 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.466967 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.467177 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.467267 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.467500 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.467600 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.467817 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.467915 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.468133 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.468222 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.468442 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.468538 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.468740 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.468836 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.469051 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.469147 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.469350 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.469438 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.469647 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.469736 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.469969 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.470064 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.470277 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.470366 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.470572 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.470662 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.470886 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.470976 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.471187 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.471281 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.471481 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.471570 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.471787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.471875 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.472089 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.472177 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.472392 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.472606 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.472695 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.472944 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.473032 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.473253 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.473343 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.473569 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.473665 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.473878 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.473982 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.474210 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.474300 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.474511 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.474612 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.474817 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.474905 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.475113 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.475202 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.475506 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.475602 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.475877 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.476141 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.476241 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.476442 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.476539 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.476742 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.476830 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.477042 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.477133 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.477352 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.477448 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.477661 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.477749 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.477975 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.478080 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.478284 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.478373 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.478583 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.478680 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.478901 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.479149 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.479238 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.479486 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.479575 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.479785 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.479884 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.480092 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.480181 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.480388 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.480483 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.480686 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.480784 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.480987 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.481075 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.481282 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.481371 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.481586 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.481675 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.481882 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.481996 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.482209 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.482305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.482504 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.482595 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.482805 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.482894 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.483102 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.483190 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.483405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.483495 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.483738 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.483833 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.484048 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.484151 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.484344 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.484433 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.484638 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.484728 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.484942 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.485040 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.485246 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.485334 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.485553 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.485697 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.485856 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.486010 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.486182 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.486272 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.486519 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.486620 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.486830 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.486921 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.487145 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.487354 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.487443 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.487685 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.487782 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.488001 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.488090 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.488335 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.488424 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.488640 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.488736 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.488954 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.489043 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.489255 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.489349 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.489561 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.489724 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.489869 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.489976 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.490202 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.490313 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.490510 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.490625 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.490816 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.490944 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.491805 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.492072 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.492184 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.492396 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.492487 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.492711 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.492807 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.493018 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.493118 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.493331 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.493459 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.493637 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.493733 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.493990 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.494085 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.494279 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.494369 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.494589 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.494677 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.494896 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.494991 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.495209 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.495298 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.495517 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.495618 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.495817 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.495907 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.496122 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.496210 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.496436 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.496533 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.496743 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.496838 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.497044 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.497132 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.497342 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.497439 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.497648 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.497736 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.497960 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.498051 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.498266 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.498367 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.498566 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.498655 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.498866 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.498953 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.499173 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.499270 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.499469 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.499580 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.499768 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.499893 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.500065 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.500209 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.500364 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.500525 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.500663 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.500834 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.500961 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.501152 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.501267 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.501468 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.501564 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.501772 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.501871 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.502110 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.502201 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.502418 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.502507 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.502739 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.502830 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.503067 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.503161 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.503386 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.503475 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.503698 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.503787 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.503998 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.504085 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.504298 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.504387 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.504594 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.504685 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.504898 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.504995 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.505213 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.505315 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.505518 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.505607 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.505817 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.505906 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.506139 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.506239 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.506446 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.506536 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.507307 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.507621 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.507761 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.507929 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.508087 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.508239 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.508400 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.508551 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.508709 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.508861 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.509026 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.509184 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.509331 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.509507 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.509635 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.509813 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.509961 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.510169 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.510260 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.510487 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.510586 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.510804 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.510905 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.511121 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.511218 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.511430 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.511527 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.511731 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.511821 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.512031 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.512121 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.512336 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.512438 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.512637 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.512726 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.512943 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.513033 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.513252 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.513342 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.513565 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.513691 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.513874 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.513982 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.514203 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.514293 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.514520 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.514610 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.514826 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.514921 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.515141 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.515231 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.515459 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.515549 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.515767 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.515868 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.516073 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.516163 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.516401 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.516502 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.516708 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.516804 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.517042 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.517131 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.517385 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.517474 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.517710 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.517807 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.518053 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.518145 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.518362 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.518452 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.518663 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.518766 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.518907 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 06:21:36.518997 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.519281 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.519607 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.519919 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.520233 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.520546 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.521109 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.521433 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.521740 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.522073 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.522817 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.523134 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.523444 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.523758 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.524065 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.524373 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.524686 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.524999 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.525320 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.525641 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.525967 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.526350 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.526670 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.527012 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.527319 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.527655 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.527976 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.528285 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.528590 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.528888 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:21:36.529127 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 06:21:36.581522 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO dbcounter [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Registered counter for database nova_api Jul 21 06:21:36.598674 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO dbcounter [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Registered counter for database nova_api Jul 21 06:21:36.693430 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_db.sqlalchemy.engines [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:21:36.701061 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writer thread running {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:21:36.717014 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG oslo_db.sqlalchemy.engines [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:21:36.723352 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG dbcounter [-] [103130] Writer thread running {{(pid=103130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:21:36.757640 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.context [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c4473db-2c5c-4a23-b88a-a9d1173a3dee(cell1) {{(pid=103129) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 06:21:36.761583 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:21:36.763190 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:21:36.763980 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:21:36.766097 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:21:36.768045 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO dbcounter [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Registered counter for database nova_cell0 Jul 21 06:21:36.772123 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO dbcounter [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Registered counter for database nova_cell1 Jul 21 06:21:36.780409 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_db.sqlalchemy.engines [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:21:36.780724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.context [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c4473db-2c5c-4a23-b88a-a9d1173a3dee(cell1) {{(pid=103130) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 06:21:36.781928 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_db.sqlalchemy.engines [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:21:36.784577 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG oslo_concurrency.lockutils [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:21:36.786162 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG oslo_concurrency.lockutils [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:21:36.786952 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG oslo_concurrency.lockutils [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:21:36.788553 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writer thread running {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:21:36.790377 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG oslo_concurrency.lockutils [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:21:36.792345 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO dbcounter [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Registered counter for database nova_cell0 Jul 21 06:21:36.793883 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writer thread running {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:21:36.796129 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO dbcounter [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Registered counter for database nova_cell1 Jul 21 06:21:36.803350 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG oslo_db.sqlalchemy.engines [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:21:36.805888 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG oslo_db.sqlalchemy.engines [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:21:36.811848 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG dbcounter [-] [103130] Writer thread running {{(pid=103130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:21:36.813107 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG dbcounter [-] [103130] Writer thread running {{(pid=103130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:21:36.938480 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO dbcounter [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Registered counter for database nova_cell0 Jul 21 06:21:36.945678 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_db.sqlalchemy.engines [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:21:36.949893 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writer thread running {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:21:36.962857 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO dbcounter [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Registered counter for database nova_cell0 Jul 21 06:21:36.969475 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG oslo_db.sqlalchemy.engines [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:21:36.974021 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG dbcounter [-] [103130] Writer thread running {{(pid=103130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:21:37.290906 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: WARNING keystonemiddleware.auth_token [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 06:21:37.297541 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: WARNING keystonemiddleware.auth_token [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 06:21:37.298175 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: WARNING keystonemiddleware.auth_token [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 06:21:37.305871 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: WARNING keystonemiddleware.auth_token [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 06:21:37.639930 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: WARNING keystonemiddleware.auth_token [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 06:21:37.646199 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: WARNING keystonemiddleware.auth_token [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 06:21:37.652060 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d8df8399c0 pid: 103129 (default app) Jul 21 06:21:37.654170 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:21:37.655359 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001761 Jul 21 06:21:37.655774 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Thu Jul 21 06:21:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:21:37.664573 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: WARNING keystonemiddleware.auth_token [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 06:21:37.670551 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: WARNING keystonemiddleware.auth_token [None req-647a35f7-26a8-42fd-af15-c43cde59d53b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 06:21:37.675827 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d8df8399c0 pid: 103130 (default app) Jul 21 06:22:54.419186 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:22:54.420188 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 21 06:22:54.420731 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:22:54.432880 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG dbcounter [-] [103130] Writing DB stats nova_api:SELECT=3 {{(pid=103130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:22:54.434031 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG dbcounter [-] [103130] Writing DB stats nova_cell0:SELECT=3 {{(pid=103130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:22:54.435037 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG dbcounter [-] [103130] Writing DB stats nova_cell1:SELECT=3 {{(pid=103130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:22:54.435755 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG dbcounter [-] [103130] Writing DB stats nova_cell0:SELECT=3 {{(pid=103130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:22:55.302068 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-48dc2624-2e94-4111-8cae-7e7d17a49f93 admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:22:55.331862 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-48dc2624-2e94-4111-8cae-7e7d17a49f93 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904261 Jul 21 06:22:55.332801 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jul 21 06:22:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:22:57.595270 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:22:57.596210 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-c6931605-9be0-46f5-b818-64df1d550391 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001380 Jul 21 06:22:57.596616 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:22:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:22:58.079016 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-7a094d3c-fa61-466d-895b-01ca252af536 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256"}} {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:22:58.097626 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 06:22:58.097626 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: warnings.warn(msg) Jul 21 06:22:58.131338 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-7a094d3c-fa61-466d-895b-01ca252af536 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.526638 Jul 21 06:22:58.132226 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 06:22:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 06:22:58.147280 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_api:SELECT=3 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:22:58.148572 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_cell0:SELECT=3 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:22:58.149427 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_cell1:SELECT=3 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:22:58.150291 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:22:58.364971 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-1e150316-87b0-4a34-884c-192eb4daf5f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:22:58.367710 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 06:22:58.367710 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: warnings.warn(msg) Jul 21 06:22:58.434995 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-1e150316-87b0-4a34-884c-192eb4daf5f8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294546 Jul 21 06:22:58.435971 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jul 21 06:22:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:23:00.738354 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-7a094d3c-fa61-466d-895b-01ca252af536 admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:00.740157 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-7a094d3c-fa61-466d-895b-01ca252af536 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Jul 21 06:23:00.740775 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:01.406962 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-92019879-ca75-48a2-98e4-5e5ce990b9bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "swap": 0, "id": "d1", "name": "ds512M"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:01.427605 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 06:23:01.427605 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: warnings.warn(msg) Jul 21 06:23:01.450984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-92019879-ca75-48a2-98e4-5e5ce990b9bd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.704107 Jul 21 06:23:01.458724 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 06:23:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:01.463880 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-017a9fa3-a08c-4b45-9f35-950652f93f8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:01.466123 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 06:23:01.466123 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: warnings.warn(msg) Jul 21 06:23:01.503106 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-017a9fa3-a08c-4b45-9f35-950652f93f8f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042919 Jul 21 06:23:01.504389 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jul 21 06:23:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:23:03.851868 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-92019879-ca75-48a2-98e4-5e5ce990b9bd admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:03.852829 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-92019879-ca75-48a2-98e4-5e5ce990b9bd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 21 06:23:03.853215 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:04.276048 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-aea841ea-cdef-49ec-89d1-ebd972568875 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:04.294503 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-aea841ea-cdef-49ec-89d1-ebd972568875 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435485 Jul 21 06:23:04.295602 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 06:23:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 06:23:04.307825 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-909ce76f-3972-47ca-8d3e-2e38b1280115 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:04.330497 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-909ce76f-3972-47ca-8d3e-2e38b1280115 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026256 Jul 21 06:23:04.331055 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jul 21 06:23:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:23:06.579581 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-aea841ea-cdef-49ec-89d1-ebd972568875 admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:06.580511 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-aea841ea-cdef-49ec-89d1-ebd972568875 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 21 06:23:06.580920 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:07.007978 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-1a52a879-8a31-4074-ab10-2cec68fb7809 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "disk": 10}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:07.031558 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-1a52a879-8a31-4074-ab10-2cec68fb7809 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444013 Jul 21 06:23:07.032224 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 06:23:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:07.044714 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-397f09f4-5efa-450c-be21-d730342e79eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:07.084211 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-397f09f4-5efa-450c-be21-d730342e79eb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043222 Jul 21 06:23:07.085180 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jul 21 06:23:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:23:09.331426 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-1a52a879-8a31-4074-ab10-2cec68fb7809 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:09.332933 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-1a52a879-8a31-4074-ab10-2cec68fb7809 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 21 06:23:09.333381 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:09.768211 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-f0b44dea-4b61-4ab2-8a34-605eeba8251d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4}} {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:09.789448 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-f0b44dea-4b61-4ab2-8a34-605eeba8251d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450440 Jul 21 06:23:09.790610 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 06:23:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:09.803633 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-976c6fb7-7f44-4bb0-9e97-a49e84f37305 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:09.827802 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-976c6fb7-7f44-4bb0-9e97-a49e84f37305 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029127 Jul 21 06:23:09.828649 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jul 21 06:23:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:23:12.085502 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-f0b44dea-4b61-4ab2-8a34-605eeba8251d admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:12.086555 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-f0b44dea-4b61-4ab2-8a34-605eeba8251d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 21 06:23:12.086956 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:12.540812 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-60aa4ec9-02bf-404f-aa66-f823c435bf41 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:12.564111 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-60aa4ec9-02bf-404f-aa66-f823c435bf41 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.471205 Jul 21 06:23:12.564770 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jul 21 06:23:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:23:15.251584 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-f0b44dea-4b61-4ab2-8a34-605eeba8251d admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:15.252554 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-f0b44dea-4b61-4ab2-8a34-605eeba8251d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 21 06:23:15.252960 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:15.731949 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-12337905-991a-47d8-938d-082afc77d43c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "ram": 512, "disk": 1, "vcpus": 1, "name": "m1.tiny"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:15.750322 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-12337905-991a-47d8-938d-082afc77d43c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.491239 Jul 21 06:23:15.750912 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 06:23:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:15.763203 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-e9c86617-99ba-49f6-930a-0a6345d66f3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:15.792392 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-e9c86617-99ba-49f6-930a-0a6345d66f3c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032419 Jul 21 06:23:15.794342 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jul 21 06:23:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:23:18.020587 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-12337905-991a-47d8-938d-082afc77d43c admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:18.021628 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-12337905-991a-47d8-938d-082afc77d43c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 Jul 21 06:23:18.022061 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:18.422305 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-75331887-33e9-4b87-9ee7-5d95e47bafd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:18.440237 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-75331887-33e9-4b87-9ee7-5d95e47bafd8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.412289 Jul 21 06:23:18.440914 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 06:23:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:18.453203 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-a0e95c55-53cf-49f8-bbf5-5db38656a5e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:18.476406 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-a0e95c55-53cf-49f8-bbf5-5db38656a5e5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026743 Jul 21 06:23:18.476985 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jul 21 06:23:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:23:20.726483 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-75331887-33e9-4b87-9ee7-5d95e47bafd8 admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:20.727517 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-75331887-33e9-4b87-9ee7-5d95e47bafd8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 21 06:23:20.727930 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:21.277026 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-26f09bbd-f922-44d7-8ff0-1a2a10cde007 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "swap": 0, "vcpus": 2, "ram": 4096}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:21.296586 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-26f09bbd-f922-44d7-8ff0-1a2a10cde007 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.562449 Jul 21 06:23:21.297378 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 06:23:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:21.310287 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-3e22c0d4-0fcd-451f-ad3e-91e8814b286a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:21.334873 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-3e22c0d4-0fcd-451f-ad3e-91e8814b286a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028153 Jul 21 06:23:21.335742 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jul 21 06:23:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:23:23.587575 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-26f09bbd-f922-44d7-8ff0-1a2a10cde007 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:23.589312 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-26f09bbd-f922-44d7-8ff0-1a2a10cde007 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002175 Jul 21 06:23:23.589927 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:24.047785 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-becc1926-bfbd-4427-82d2-56d898c0f623 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4}} {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:24.070611 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-becc1926-bfbd-4427-82d2-56d898c0f623 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474040 Jul 21 06:23:24.078358 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 06:23:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:24.085296 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-a201fea3-2efb-44c5-9cac-44f1f52eccb5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:24.110931 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-a201fea3-2efb-44c5-9cac-44f1f52eccb5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030425 Jul 21 06:23:24.111693 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jul 21 06:23:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:23:26.422823 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-becc1926-bfbd-4427-82d2-56d898c0f623 admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:26.424577 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-becc1926-bfbd-4427-82d2-56d898c0f623 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002229 Jul 21 06:23:26.425194 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:26.856887 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-cedee8ba-f9a1-4a69-996d-f3c636c516d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "swap": 0}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:26.876249 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-cedee8ba-f9a1-4a69-996d-f3c636c516d9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.442897 Jul 21 06:23:26.876978 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 06:23:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:26.889359 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-b95a0493-6c8a-4b01-a28d-3c5583e91273 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:26.893971 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG dbcounter [-] [103130] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:23:26.915627 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-b95a0493-6c8a-4b01-a28d-3c5583e91273 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030001 Jul 21 06:23:26.916234 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jul 21 06:23:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:23:46.248021 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-cedee8ba-f9a1-4a69-996d-f3c636c516d9 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:46.249025 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-cedee8ba-f9a1-4a69-996d-f3c636c516d9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 21 06:23:46.249426 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:46.637637 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-7a150173-b363-42a3-b3a9-6ddf0066ce8f admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:46.655263 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-7a150173-b363-42a3-b3a9-6ddf0066ce8f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399878 Jul 21 06:23:46.655792 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jul 21 06:23:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:23:47.729754 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-cedee8ba-f9a1-4a69-996d-f3c636c516d9 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:47.730784 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-cedee8ba-f9a1-4a69-996d-f3c636c516d9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 21 06:23:47.731179 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:23:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:48.253743 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-fec0d98f-6a11-4e12-9968-ddf259235173 admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:48.260409 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.wsgi [None req-fec0d98f-6a11-4e12-9968-ddf259235173 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-fec0d98f-6a11-4e12-9968-ddf259235173 admin admin] Request method failure captured: Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Accept: application/json Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Accept-Encoding: gzip, deflate Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Connection: keep-alive Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Content-Length: 0 Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Host: 10.222.0.42 Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Openstack-Api-Version: compute 2.90 Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Openstack-System-Scope: None Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: User-Agent: python-novaclient Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Auth-Token: gAAAAABi2PDzy3GCGPzgRtjrYBC6_AF0BuoqnAkuibPhhuHFtw440PRLHcBHDDSQn9fqzXE0JOJb6Oim1kB4Q5c1SBrKtpInAMQ4QVPDcQ5Bae4ivtWSyXgRiLQFyBfdLsGuuRfjkX06_9NsrIA7mo_11TlHOXFtGwHbGMLwFKOK9KJBU2rdS5c Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Domain-Id: None Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Domain-Name: None Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Identity-Status: Confirmed Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Is-Admin-Project: True Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Domain-Id: default Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Domain-Name: Default Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Name: admin Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Role: reader,admin,member Jul 21 06:23:48.263657 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Roles: reader,admin,member Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c098b85eefc14c3cac1c96ebb357b960"}]}] Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Tenant: admin Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Tenant-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Tenant-Name: admin Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User: admin Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Domain-Id: default Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Domain-Name: Default Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Id: a1033721c1da485882816b21d7d01a42 Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Name: admin Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: method: > Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: exception: Flavor 42 could not be found. Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: action_args: {'id': '42'} Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:23:48.265405 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:48.266724 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:48.268122 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-fec0d98f-6a11-4e12-9968-ddf259235173 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:23:48.269477 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-fec0d98f-6a11-4e12-9968-ddf259235173 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397837 Jul 21 06:23:48.269477 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jul 21 06:23:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 06:23:48.275574 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-1d536544-32e8-48b1-a711-f6045e5b3426 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:48.278547 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:23:48.297519 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-1d536544-32e8-48b1-a711-f6045e5b3426 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025526 Jul 21 06:23:48.298106 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 06:23:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:23:48.308558 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-da10abca-4eb2-4192-a561-48cbdad68d7f admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:48.330606 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-da10abca-4eb2-4192-a561-48cbdad68d7f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025548 Jul 21 06:23:48.331129 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 06:23:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:23:48.341333 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-e28bda01-ad14-4c24-a852-800f2d2035d8 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:48.347469 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.wsgi [None req-e28bda01-ad14-4c24-a852-800f2d2035d8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-e28bda01-ad14-4c24-a852-800f2d2035d8 admin admin] Request method failure captured: Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Accept: application/json Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Accept-Encoding: gzip, deflate Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Connection: keep-alive Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Content-Length: 0 Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Host: 10.222.0.42 Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Openstack-Api-Version: compute 2.90 Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Openstack-System-Scope: None Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: User-Agent: python-novaclient Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Auth-Token: gAAAAABi2PDzy3GCGPzgRtjrYBC6_AF0BuoqnAkuibPhhuHFtw440PRLHcBHDDSQn9fqzXE0JOJb6Oim1kB4Q5c1SBrKtpInAMQ4QVPDcQ5Bae4ivtWSyXgRiLQFyBfdLsGuuRfjkX06_9NsrIA7mo_11TlHOXFtGwHbGMLwFKOK9KJBU2rdS5c Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Domain-Id: None Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Domain-Name: None Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Identity-Status: Confirmed Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Is-Admin-Project: True Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Domain-Id: default Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Domain-Name: Default Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Name: admin Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Role: reader,admin,member Jul 21 06:23:48.351478 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Roles: reader,admin,member Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c098b85eefc14c3cac1c96ebb357b960"}]}] Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Tenant: admin Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Tenant-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Tenant-Name: admin Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User: admin Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Domain-Id: default Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Domain-Name: Default Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Id: a1033721c1da485882816b21d7d01a42 Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Name: admin Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: method: > Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: exception: Flavor 42 could not be found. Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: action_args: {'id': '42'} Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:23:48.352994 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:48.353984 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:48.355316 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-e28bda01-ad14-4c24-a852-800f2d2035d8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:23:48.356534 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-e28bda01-ad14-4c24-a852-800f2d2035d8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015593 Jul 21 06:23:48.356534 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jul 21 06:23:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 06:23:49.326872 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-da10abca-4eb2-4192-a561-48cbdad68d7f admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:49.327880 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-da10abca-4eb2-4192-a561-48cbdad68d7f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 21 06:23:49.328272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:49.861169 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-bb3ee7b8-3191-43c3-8b6f-2d9e86415698 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:49.866547 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.wsgi [None req-bb3ee7b8-3191-43c3-8b6f-2d9e86415698 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-bb3ee7b8-3191-43c3-8b6f-2d9e86415698 admin admin] Request method failure captured: Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Accept: application/json Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Accept-Encoding: gzip, deflate Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Connection: keep-alive Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Content-Length: 0 Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Host: 10.222.0.42 Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Openstack-Api-Version: compute 2.90 Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Openstack-System-Scope: None Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: User-Agent: python-novaclient Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Auth-Token: gAAAAABi2PD1U93RYVINZzGr7g4rqS7oWBe8VLjiBouQme9NKUaZiGDYyzEsa6dQVLfG6FnsjrTTteS9_eoWaWvmxYVScCyxHPE42F8koz3_cAr1GDVTA25tFKnmYxoVpdf7l45aiERLGm4zPLkVQneLOTbleDCf7X_yvCsPGZ7pnswqa0zD7H0 Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Domain-Id: None Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Domain-Name: None Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Identity-Status: Confirmed Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Is-Admin-Project: True Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Domain-Id: default Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Domain-Name: Default Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Name: admin Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Role: reader,admin,member Jul 21 06:23:49.868078 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Roles: reader,admin,member Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c098b85eefc14c3cac1c96ebb357b960"}]}] Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Tenant: admin Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Tenant-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Tenant-Name: admin Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User: admin Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Domain-Id: default Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Domain-Name: Default Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Id: a1033721c1da485882816b21d7d01a42 Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Name: admin Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: method: > Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: exception: Flavor 84 could not be found. Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: action_args: {'id': '84'} Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:23:49.869346 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:49.870261 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:49.871530 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-bb3ee7b8-3191-43c3-8b6f-2d9e86415698 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:23:49.872789 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-bb3ee7b8-3191-43c3-8b6f-2d9e86415698 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397625 Jul 21 06:23:49.872789 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jul 21 06:23:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 06:23:49.879717 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-4466a327-be82-458e-bfa6-e625de00bade admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:49.893037 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-4466a327-be82-458e-bfa6-e625de00bade admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017481 Jul 21 06:23:49.893564 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 06:23:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:23:49.903632 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-10105b6c-2bdf-43a6-9810-cdbe7516a416 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:49.917329 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-10105b6c-2bdf-43a6-9810-cdbe7516a416 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017190 Jul 21 06:23:49.917850 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 06:23:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:23:49.927606 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-0efb0988-772c-4b5a-96ad-006feb8de390 admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:49.932988 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.wsgi [None req-0efb0988-772c-4b5a-96ad-006feb8de390 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-0efb0988-772c-4b5a-96ad-006feb8de390 admin admin] Request method failure captured: Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Accept: application/json Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Accept-Encoding: gzip, deflate Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Connection: keep-alive Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Content-Length: 0 Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Host: 10.222.0.42 Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Openstack-Api-Version: compute 2.90 Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Openstack-System-Scope: None Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: User-Agent: python-novaclient Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Auth-Token: gAAAAABi2PD1U93RYVINZzGr7g4rqS7oWBe8VLjiBouQme9NKUaZiGDYyzEsa6dQVLfG6FnsjrTTteS9_eoWaWvmxYVScCyxHPE42F8koz3_cAr1GDVTA25tFKnmYxoVpdf7l45aiERLGm4zPLkVQneLOTbleDCf7X_yvCsPGZ7pnswqa0zD7H0 Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Domain-Id: None Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Domain-Name: None Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Identity-Status: Confirmed Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Is-Admin-Project: True Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Domain-Id: default Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Domain-Name: Default Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Name: admin Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Role: reader,admin,member Jul 21 06:23:49.934527 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Roles: reader,admin,member Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c098b85eefc14c3cac1c96ebb357b960"}]}] Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Tenant: admin Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Tenant-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Tenant-Name: admin Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User: admin Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Domain-Id: default Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Domain-Name: Default Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Id: a1033721c1da485882816b21d7d01a42 Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Name: admin Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: method: > Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: exception: Flavor 84 could not be found. Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: action_args: {'id': '84'} Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:23:49.936028 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:49.936970 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:49.938272 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-0efb0988-772c-4b5a-96ad-006feb8de390 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:23:49.939479 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-0efb0988-772c-4b5a-96ad-006feb8de390 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012378 Jul 21 06:23:49.939479 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jul 21 06:23:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 06:23:50.910858 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-10105b6c-2bdf-43a6-9810-cdbe7516a416 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:50.911944 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-10105b6c-2bdf-43a6-9810-cdbe7516a416 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Jul 21 06:23:50.912334 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:23:51.438800 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-1ff5e878-3fbf-4162-95a0-bb0a19f4fb13 admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:51.444656 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.wsgi [None req-1ff5e878-3fbf-4162-95a0-bb0a19f4fb13 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-1ff5e878-3fbf-4162-95a0-bb0a19f4fb13 admin admin] Request method failure captured: Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Accept: application/json Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Accept-Encoding: gzip, deflate Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Connection: keep-alive Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Content-Length: 0 Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Host: 10.222.0.42 Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Openstack-Api-Version: compute 2.90 Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Openstack-System-Scope: None Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: User-Agent: python-novaclient Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Auth-Token: gAAAAABi2PD2eN749EYdT5I5btbLvKUZzri_ft6IjIuQIX_pEKL1qaBp9ILP72F2MCSAYF4nTgGgNtrllx_awMPhYsjoo1C_l9FNUxA7Wk-8eOPkLBXfOcPaUH7_CnzBeYMLzPgca2Cy81n6gAWo8nXne1AO6eN0dE74Umhdr9BpIbLxbE3WcKc Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Domain-Id: None Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Domain-Name: None Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Identity-Status: Confirmed Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Is-Admin-Project: True Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Domain-Id: default Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Domain-Name: Default Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Project-Name: admin Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Role: reader,admin,member Jul 21 06:23:51.446191 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Roles: reader,admin,member Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c098b85eefc14c3cac1c96ebb357b960"}]}] Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Tenant: admin Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Tenant-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-Tenant-Name: admin Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User: admin Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Domain-Id: default Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Domain-Name: Default Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Id: a1033721c1da485882816b21d7d01a42 Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: X-User-Name: admin Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: method: > Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: exception: Flavor 451 could not be found. Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: action_args: {'id': '451'} Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:23:51.447793 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:51.448858 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: ERROR nova.api.openstack.wsgi Jul 21 06:23:51.450436 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-1ff5e878-3fbf-4162-95a0-bb0a19f4fb13 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:23:51.451761 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-1ff5e878-3fbf-4162-95a0-bb0a19f4fb13 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390089 Jul 21 06:23:51.451761 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 06:23:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 06:23:51.457070 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-861fb988-1449-449f-ab8c-9b67103f5159 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:51.470602 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-861fb988-1449-449f-ab8c-9b67103f5159 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017061 Jul 21 06:23:51.471113 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 06:23:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:23:51.480713 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:51.494644 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017449 Jul 21 06:23:51.495161 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 06:23:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:23:51.504002 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-b84ab287-2ee8-45d6-b78b-8cd8ef78c560 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:51.509263 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.wsgi [None req-b84ab287-2ee8-45d6-b78b-8cd8ef78c560 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-b84ab287-2ee8-45d6-b78b-8cd8ef78c560 admin admin] Request method failure captured: Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Accept: application/json Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Accept-Encoding: gzip, deflate Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Connection: keep-alive Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Content-Length: 0 Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Host: 10.222.0.42 Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Openstack-Api-Version: compute 2.90 Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Openstack-System-Scope: None Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: User-Agent: python-novaclient Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Auth-Token: gAAAAABi2PD2eN749EYdT5I5btbLvKUZzri_ft6IjIuQIX_pEKL1qaBp9ILP72F2MCSAYF4nTgGgNtrllx_awMPhYsjoo1C_l9FNUxA7Wk-8eOPkLBXfOcPaUH7_CnzBeYMLzPgca2Cy81n6gAWo8nXne1AO6eN0dE74Umhdr9BpIbLxbE3WcKc Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Domain-Id: None Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Domain-Name: None Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Identity-Status: Confirmed Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Is-Admin-Project: True Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Domain-Id: default Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Domain-Name: Default Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Project-Name: admin Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Role: reader,admin,member Jul 21 06:23:51.510787 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Roles: reader,admin,member Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c098b85eefc14c3cac1c96ebb357b960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c098b85eefc14c3cac1c96ebb357b960"}]}] Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Tenant: admin Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Tenant-Id: c098b85eefc14c3cac1c96ebb357b960 Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-Tenant-Name: admin Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User: admin Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Domain-Id: default Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Domain-Name: Default Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Id: a1033721c1da485882816b21d7d01a42 Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: X-User-Name: admin Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: method: > Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: exception: Flavor 451 could not be found. Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: action_args: {'id': '451'} Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:23:51.512305 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:51.513376 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jul 21 06:23:51.514653 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-b84ab287-2ee8-45d6-b78b-8cd8ef78c560 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:23:51.515943 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-b84ab287-2ee8-45d6-b78b-8cd8ef78c560 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011550 Jul 21 06:23:51.515943 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 06:23:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 06:23:52.477737 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:52.478761 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 21 06:23:52.479148 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:52.998487 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-583edf1b-2f9e-42cd-a42c-5625fa0485cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:53.016810 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-583edf1b-2f9e-42cd-a42c-5625fa0485cb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401339 Jul 21 06:23:53.017355 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jul 21 06:23:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:53.997004 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:53.998029 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jul 21 06:23:53.998431 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:54.526382 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-6daa288e-1ee8-4fe1-abd8-93526127fb92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:54.543564 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-6daa288e-1ee8-4fe1-abd8-93526127fb92 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.405788 Jul 21 06:23:54.544100 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jul 21 06:23:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:55.503759 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:55.504896 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 21 06:23:55.505288 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:56.030013 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-eb956300-559d-407c-bfdc-9eb8b3e4cbe0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:56.046903 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-eb956300-559d-407c-bfdc-9eb8b3e4cbe0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404581 Jul 21 06:23:56.047452 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jul 21 06:23:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:57.022421 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:57.023417 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 21 06:23:57.023806 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:57.550020 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-2ce3462f-66ca-4784-bebe-f03229ff862e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:23:57.569354 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-2ce3462f-66ca-4784-bebe-f03229ff862e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403979 Jul 21 06:23:57.569873 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jul 21 06:23:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:23:58.554193 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:58.555200 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 21 06:23:58.555595 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:23:59.076067 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-dfedb33e-1982-4c66-977f-8dd0ec39b191 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:23:59.095052 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-dfedb33e-1982-4c66-977f-8dd0ec39b191 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401415 Jul 21 06:23:59.095589 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Thu Jul 21 06:23:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:24:50.930582 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:24:50.931576 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-61af64be-7c90-4f4f-87eb-2b43f33ac49d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 21 06:24:50.931972 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 06:24:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:24:50.942161 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:24:51.325439 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-8c994a79-7d6d-43bb-9bb1-60065fcd8246 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:24:51.346445 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-8c994a79-7d6d-43bb-9bb1-60065fcd8246 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408710 Jul 21 06:24:51.346986 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jul 21 06:24:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:24:51.370782 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-187fb9b3-d5cd-412e-a5a2-7ec248c572bc admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:24:51.374194 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG dbcounter [-] [103130] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:24:51.380582 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-187fb9b3-d5cd-412e-a5a2-7ec248c572bc admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013328 Jul 21 06:24:51.381639 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Thu Jul 21 06:24:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:24:51.393014 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-b1fbe395-b92d-4c62-82b7-57a4963f4509 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:24:51.401271 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-b1fbe395-b92d-4c62-82b7-57a4963f4509 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011739 Jul 21 06:24:51.401769 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Thu Jul 21 06:24:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:24:51.413195 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-b9ffb243-6ef2-4233-a616-5e961d52e22f admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:24:51.421210 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-b9ffb243-6ef2-4233-a616-5e961d52e22f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012050 Jul 21 06:24:51.421756 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Thu Jul 21 06:24:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:24:51.433648 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-5dcb7e93-a492-493c-ba21-d5f10b568f80 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:24:51.441052 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-5dcb7e93-a492-493c-ba21-d5f10b568f80 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010877 Jul 21 06:24:51.441557 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Thu Jul 21 06:24:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:28:12.936810 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-b9ffb243-6ef2-4233-a616-5e961d52e22f admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:28:12.937811 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-b9ffb243-6ef2-4233-a616-5e961d52e22f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Jul 21 06:28:12.938246 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:28:13.087908 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_api:SELECT=6 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:28:13.248729 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-7c1e03e9-fc69-40d4-af80-35229f3edb09 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:28:13.249997 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 06:28:13.249997 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: warnings.warn(msg) Jul 21 06:28:13.251210 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-7c1e03e9-fc69-40d4-af80-35229f3edb09 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:28:13.251686 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-7c1e03e9-fc69-40d4-af80-35229f3edb09 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:28:13.252467 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-7c1e03e9-fc69-40d4-af80-35229f3edb09 admin admin] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:28:13.252895 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-7c1e03e9-fc69-40d4-af80-35229f3edb09 admin admin] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:28:13.287585 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-7c1e03e9-fc69-40d4-af80-35229f3edb09 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201041 Jul 21 06:28:13.288143 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 06:28:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:28:14.112699 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-b9ffb243-6ef2-4233-a616-5e961d52e22f admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:28:14.113708 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-b9ffb243-6ef2-4233-a616-5e961d52e22f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 21 06:28:14.114180 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:28:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:28:14.307892 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-b3254c12-e95b-4b51-8d43-b4f2870c3c1c admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:28:14.309068 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 06:28:14.309068 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: warnings.warn(msg) Jul 21 06:28:14.310280 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-b3254c12-e95b-4b51-8d43-b4f2870c3c1c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:28:14.310738 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-b3254c12-e95b-4b51-8d43-b4f2870c3c1c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:28:14.311980 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-b3254c12-e95b-4b51-8d43-b4f2870c3c1c admin admin] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:28:14.312427 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-b3254c12-e95b-4b51-8d43-b4f2870c3c1c admin admin] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:28:14.331980 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-b3254c12-e95b-4b51-8d43-b4f2870c3c1c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076241 Jul 21 06:28:14.332513 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 06:28:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:28:25.591488 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-b9ffb243-6ef2-4233-a616-5e961d52e22f admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:28:25.592545 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-b9ffb243-6ef2-4233-a616-5e961d52e22f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jul 21 06:28:25.592938 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:28:25.735595 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_cell0:SELECT=4 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:28:25.736311 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_cell1:SELECT=4 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:28:25.736970 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_api:SELECT=8 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:28:25.784740 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-ddf8bd28-84f2-429f-b02b-c235b4f84263 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:28:25.786245 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 06:28:25.786245 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: warnings.warn(msg) Jul 21 06:28:25.787450 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-ddf8bd28-84f2-429f-b02b-c235b4f84263 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:28:25.787887 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-ddf8bd28-84f2-429f-b02b-c235b4f84263 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:28:25.788667 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-ddf8bd28-84f2-429f-b02b-c235b4f84263 admin admin] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:28:25.789094 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-ddf8bd28-84f2-429f-b02b-c235b4f84263 admin admin] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:28:25.814025 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-ddf8bd28-84f2-429f-b02b-c235b4f84263 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083482 Jul 21 06:28:25.814501 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 06:28:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:28:26.640412 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: DEBUG nova.api.openstack.wsgi [None req-b9ffb243-6ef2-4233-a616-5e961d52e22f admin admin] Calling method '>' {{(pid=103130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:28:26.642042 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: INFO nova.api.openstack.requestlog [None req-b9ffb243-6ef2-4233-a616-5e961d52e22f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Jul 21 06:28:26.642435 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: [pid: 103130|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 06:28:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:28:26.832286 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-dca3264d-8954-4e23-9d6c-3c1c97b1856b admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:28:26.833466 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 06:28:26.833466 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: warnings.warn(msg) Jul 21 06:28:26.834670 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-dca3264d-8954-4e23-9d6c-3c1c97b1856b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:28:26.835108 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-dca3264d-8954-4e23-9d6c-3c1c97b1856b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:28:26.835899 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-dca3264d-8954-4e23-9d6c-3c1c97b1856b admin admin] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:28:26.836321 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-dca3264d-8954-4e23-9d6c-3c1c97b1856b admin admin] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:28:26.858054 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-dca3264d-8954-4e23-9d6c-3c1c97b1856b admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078017 Jul 21 06:28:26.858533 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 06:28:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:29:21.717532 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: Thu Jul 21 06:29:21 2022 - graceful shutdown triggered... Jul 21 06:29:21.717566 dv-cinder-850318-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 06:29:21.718496 dv-cinder-850318-3-iscsi devstack@n-api.service[103130]: Gracefully killing worker 2 (pid: 103130)... Jul 21 06:29:21.718966 dv-cinder-850318-3-iscsi devstack@n-api.service[103129]: Gracefully killing worker 1 (pid: 103129)... Jul 21 06:29:22.718078 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: worker 1 buried after 1 seconds Jul 21 06:29:22.718633 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: worker 2 buried after 1 seconds Jul 21 06:29:22.718633 dv-cinder-850318-3-iscsi devstack@n-api.service[103128]: goodbye to uWSGI. Jul 21 06:29:22.720195 dv-cinder-850318-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 06:29:22.720740 dv-cinder-850318-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 06:29:22.723575 dv-cinder-850318-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 06:29:22.732837 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 06:29:22.736195 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 06:29:22 2022] *** Jul 21 06:29:22.736368 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 06:29:22.736511 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 06:29:22.736663 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: nodename: dv-cinder-850318-3-iscsi Jul 21 06:29:22.736830 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: machine: x86_64 Jul 21 06:29:22.736954 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: clock source: unix Jul 21 06:29:22.737083 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: pcre jit disabled Jul 21 06:29:22.737194 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: detected number of CPU cores: 4 Jul 21 06:29:22.737302 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: current working directory: / Jul 21 06:29:22.737411 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: detected binary path: /usr/bin/uwsgi-core Jul 21 06:29:22.737528 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: your processes number limit is 47680 Jul 21 06:29:22.737789 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: your memory page size is 4096 bytes Jul 21 06:29:22.737789 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: detected max file descriptor number: 2048 Jul 21 06:29:22.737789 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: lock engine: pthread robust mutexes Jul 21 06:29:22.738109 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: thunder lock: enabled Jul 21 06:29:22.738187 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 06:29:22.738265 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 06:29:22.782917 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: Python main interpreter initialized at 0x55ff9ccf19c0 Jul 21 06:29:22.783218 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: python threads support enabled Jul 21 06:29:22.783466 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: your server socket listen backlog is limited to 100 connections Jul 21 06:29:22.783633 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: your mercy for graceful operations on workers is 90 seconds Jul 21 06:29:22.784338 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 06:29:22.784594 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: *** Operational MODE: preforking *** Jul 21 06:29:22.785073 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: *** uWSGI is running in multiple interpreter mode *** Jul 21 06:29:22.785237 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: spawned uWSGI master process (pid: 117887) Jul 21 06:29:22.785590 dv-cinder-850318-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 06:29:22.788414 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: spawned uWSGI worker 1 (pid: 117905, cores: 1) Jul 21 06:29:22.788966 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: spawned uWSGI worker 2 (pid: 117906, cores: 1) Jul 21 06:29:22.789308 dv-cinder-850318-3-iscsi devstack@n-api.service[117887]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 06:29:23.451747 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 06:29:23.452315 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 06:29:24.647354 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 06:29:24.647354 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: from cryptography.utils import int_from_bytes Jul 21 06:29:24.647976 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 06:29:24.647976 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: from cryptography.utils import int_from_bytes Jul 21 06:29:24.650081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 06:29:24.650081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: from cryptography.utils import int_from_bytes Jul 21 06:29:24.650602 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 06:29:24.650602 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: from cryptography.utils import int_from_bytes Jul 21 06:29:26.950368 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 06:29:26.951008 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 06:29:26.951287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 06:29:26.951518 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 06:29:26.951861 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 06:29:26.953730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.953730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.953730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.953730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.953730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.953730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.954584 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.954681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 06:29:26.955055 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.955149 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 06:29:26.955247 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.955247 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.955410 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 06:29:26.955500 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.955626 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 06:29:26.955837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850318-3-iscsi {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.955931 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 06:29:26.957004 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.957139 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.957218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.957300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.957384 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.957468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.957562 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.957645 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.957769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.957769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.957923 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.958040 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.958124 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.958407 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.958512 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.958720 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.958898 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.959008 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.959213 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.959322 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.959528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.959630 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.959872 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.960005 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850318-3-iscsi {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.960202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.960302 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.960514 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.960622 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.960811 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.960911 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.961121 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.961221 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.961424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.961515 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.961748 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.961894 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.962085 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.962199 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850318-3-iscsi {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.962492 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.962592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.962812 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.962914 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.963133 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.963224 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.963477 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.963578 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.963815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.963928 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.964131 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.964224 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.964441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.964571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.964760 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.964900 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.965068 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.965200 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.965392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.965496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.965701 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.965792 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.966055 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.966165 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850318-3-iscsi {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.966384 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.966484 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.966695 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.966801 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.967011 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.967103 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.967325 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.967422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.967649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.967758 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.967965 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.968079 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.968273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.968372 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.968530 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.968630 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.968847 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.968964 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.969838 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.970029 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.970232 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.970406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.970564 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.970671 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.970824 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.970925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.971080 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.971231 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.971406 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.971545 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.971735 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.971842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.972053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.972166 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.972370 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.972469 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.972685 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.972784 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.972999 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.973097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.973308 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.973398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.973618 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.973718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.973930 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.974036 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.974266 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.974365 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.974527 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.974619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.974784 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.974884 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.975109 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.975218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.975436 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.975541 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.975748 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.975847 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.976057 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.976218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.976369 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.976507 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.976680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.976779 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.976989 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.977095 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.977298 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.977411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.977606 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.977724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.977916 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.978209 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.978297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.978381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.978561 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.978687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.979000 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.979106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.979297 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.979395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.979619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.979958 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.980276 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.980447 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.980596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.980825 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.980985 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.981148 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.981301 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.981445 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.981594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.981744 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.981907 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.982091 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.982250 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.982402 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.982545 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.982693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.982836 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.982986 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.983136 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.983289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.983439 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.983592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.983734 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.983900 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.984049 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.984201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.984351 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.984505 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.984647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.985863 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.986162 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.986349 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.986512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.986666 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.986812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.986911 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.987004 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.987095 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.987179 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.987260 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.987352 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.987433 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.987566 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.987653 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.987850 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.987960 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.988185 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.988288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.988496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.988604 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.988808 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.989051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.989191 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.989366 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.989472 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.989678 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.989778 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.990010 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.990120 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.990332 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.990463 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.990665 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.990845 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.991004 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.991210 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.991322 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.991516 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.991630 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.991848 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.991954 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.992192 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.992346 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.992507 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.992698 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.992815 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.993062 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.993161 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.993379 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.993491 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.993692 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.993796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.994021 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.994136 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.994334 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.994449 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.994640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.994884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.994998 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.995217 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.995315 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.995580 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.995676 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.995895 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.996076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.996184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.996494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.996662 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.996842 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:26.997067 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.997175 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:26.997398 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.997499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:26.997825 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:26.998063 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.998183 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:26.998498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:26.998600 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.998817 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.998918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:26.999134 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:26.999283 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.999451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.999542 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:26.999765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:26.999865 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.000075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.000178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.000742 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.000863 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.000954 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.001054 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.001148 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.001243 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.001333 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.001424 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.001607 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.001742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.001911 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.002099 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.002256 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.002425 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.002580 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.002753 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.002895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.003072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.003207 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.003400 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.003515 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.003736 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.003837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 06:29:27.004065 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.004165 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.004386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.004485 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.004735 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.004827 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.005084 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.005190 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.005418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.005510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.005748 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.005848 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.006105 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.006211 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.006421 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.006512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.006740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.006861 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.007056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.007199 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.007375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.007468 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.007693 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.007793 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.008008 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.008100 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.008328 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.008418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.008646 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.008753 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.008963 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.009055 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.009278 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.009378 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.009595 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.009692 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.009908 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.010039 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.010244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.010346 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.010567 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.010661 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.010884 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.010983 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.011203 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.011295 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.011517 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.011609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.011832 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.011929 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.012148 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.012239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.012466 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.012559 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.012775 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.012874 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.013084 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.013176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.013393 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.013484 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.013708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.013807 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.014040 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.014149 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.014364 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.014455 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.014693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.014790 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.015003 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.015102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.015323 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.015418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.015635 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.015736 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.016000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.016467 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.016570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.016663 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.016765 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.017000 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.017098 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.017275 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.017595 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.017843 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.018045 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.018244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.018434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.018604 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.018761 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.018913 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.019057 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.019198 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.019350 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.019494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.019660 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.019816 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.019968 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.020147 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.020309 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.020575 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.020740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.020891 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.021974 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.022110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.022380 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.022483 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.022598 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.022598 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.022819 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.022931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.022931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.023071 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.023144 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.023402 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.023526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.023705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.023918 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.024010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.024334 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.024641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.024742 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.024954 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.025055 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.025267 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.025369 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.025576 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.025678 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.025891 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.026027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.026227 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.026372 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.026536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.026651 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.026849 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.026959 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.028172 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.028355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.028513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.028683 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.028830 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.028971 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.029112 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.029250 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.029390 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.029543 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.029683 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.029828 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030140 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030234 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030332 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030425 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030517 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030601 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030683 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030774 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030865 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030957 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.030957 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.031163 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.031997 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.032550 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.032877 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.033110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.033307 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.033469 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.033879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.034097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.034258 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.034413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.034548 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.034706 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.034825 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.035032 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.035165 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.035350 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.035475 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.035681 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.035824 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.036006 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.036138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.036331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.036464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.036644 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.036751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.036966 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.037065 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.037309 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.037435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.037635 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.037740 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.037931 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.038112 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.038294 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.038385 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.038607 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.038716 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.038982 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.039081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.039299 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.039402 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.039613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.039705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.039929 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.040027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.040249 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.040472 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.040578 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.040882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.041207 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.041528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.042456 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.042697 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.042855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.043038 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.043135 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.043352 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.043470 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.043665 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.043779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.043990 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.044096 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.044333 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.044470 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.044670 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.044784 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.044990 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.045100 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.045310 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.045494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.045670 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.045822 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.045979 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.046295 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.046592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.046711 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.046913 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.047814 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.048097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.048312 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.048642 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.048847 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.048954 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.049276 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.049552 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.049673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.049901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.050246 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.050529 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.050640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.050860 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.051182 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.051513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.051654 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.051835 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.052165 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.052417 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.052527 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.052794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.053105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.053289 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.053435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.053755 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.054064 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.054173 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.054390 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.054655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.054763 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.054996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.055104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.055343 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.055456 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.055651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.055748 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.055981 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.056079 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.056302 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.056398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.056616 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.056720 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.056939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.057039 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.057254 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.057352 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.057561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.057648 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.057882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.058007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.058233 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.058388 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.058533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.058688 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.058834 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.058985 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.059143 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.059288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.059439 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.059591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.059758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.059919 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.060087 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.060238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.060390 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.060558 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.060719 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.060875 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.061026 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.061200 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.061349 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.061501 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.061654 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.061813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.062043 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.062218 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.062371 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.062515 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.066266 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.066492 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.067733 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.067905 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.068059 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.068221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.068386 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.068543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.068691 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.068838 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.068991 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.069144 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.069402 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.069581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.069735 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.069881 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.070069 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.070226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.070380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.070532 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.070685 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.070838 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.070997 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.071149 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.071305 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.071451 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.071606 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.071759 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.071905 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.072060 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.072213 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.072359 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.072502 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.072661 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.072815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.072968 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.073120 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.073272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.073419 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.073587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.073734 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.073886 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.074098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.074254 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.074414 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.074561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.074714 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.074860 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.075010 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.075164 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.075318 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.075463 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.075621 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.075773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.075926 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.076702 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.076861 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.077016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.077161 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.077852 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.078054 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.078219 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.078424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.078646 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.078822 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.078971 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.079166 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.079314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.079458 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.079603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.079748 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.079899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.080059 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.080206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.080350 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.080494 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.080652 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.080819 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.080977 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.081138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.081287 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.081440 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.081592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.081737 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.081900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.082086 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.082242 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.082389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.082533 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.082702 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.082856 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.083009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.083153 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.083297 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.083440 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.083598 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.083743 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.083888 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.084041 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.084193 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.084337 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.084495 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.084658 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.084804 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.084957 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.085111 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.085262 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.085262 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.085610 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.085610 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.085610 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.086180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.086464 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.086464 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.086813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.086971 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.087117 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.087285 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.087285 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.088189 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.088355 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.088355 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.088836 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.088998 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.088998 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.089291 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.089479 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.089479 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.089788 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.089990 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.089990 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.090288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.090441 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.090441 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.090714 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.090882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.090882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.091186 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.091333 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.091333 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.091628 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.091773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.091773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.092061 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.092206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.092365 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.092510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.092510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.092791 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.092942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.092942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.093313 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.093459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.093622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.093775 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.093775 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.094608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.094764 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.094764 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.095048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.095192 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.095336 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.095495 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.095495 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.095791 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.095942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.095942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.096247 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.096411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.096565 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.096724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.096876 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.097035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.097203 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.097355 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.097534 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.098261 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.098425 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.098592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.098766 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.098927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.099080 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.099240 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.099392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.099542 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.099704 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.099864 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.100015 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.100204 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.100356 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.100515 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.100677 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.100840 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.100992 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.101144 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.101343 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.101499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.101666 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.101824 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.102004 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.102210 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.102365 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.102543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.102700 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.102871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.103025 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.103184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.103343 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.103509 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.103662 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.103815 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.103976 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.104136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.104320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.104545 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.104720 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.104874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.105065 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.105248 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.105409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.105575 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.105728 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.105880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.106105 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.106105 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.106489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.106649 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.106851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.107011 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.107170 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.107170 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.107488 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.107647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.108428 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.108614 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.108776 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.108944 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.109129 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.109287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.109287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.109611 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.110346 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.110517 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.110676 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.110828 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.110981 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111134 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111288 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111443 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.111745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.112869 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.112869 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.112869 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.112869 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.112869 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.113592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.113757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.113757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.113757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.113757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.113757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.115103 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.115257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.115257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.115562 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.115723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.115881 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.116041 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.116232 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.116393 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.116545 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.116703 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.116855 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.117024 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.117176 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.117335 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.117487 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.117637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.117796 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.118637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.118807 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.118975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.118975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.119263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.119430 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.119584 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.119759 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.119912 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.120063 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.120222 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.120373 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.120532 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.120698 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.120850 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.121001 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.121159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.121319 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.121479 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.121666 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.121827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.121997 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.122155 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.122320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.122471 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.122634 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.122788 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.122939 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.123089 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.123248 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.123409 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.123560 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.123721 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.123881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.124041 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.124201 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.124361 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.124512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.124672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.124825 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.124984 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.125135 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.125362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.125555 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.125555 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.126064 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.126232 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.126386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.126616 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.126770 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.126923 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.127075 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.127225 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.127386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.127538 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.127690 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.127841 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.127992 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.128154 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.129133 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.129297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.129450 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.129611 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.129771 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.129925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.130115 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.130275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.130434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.130595 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.130754 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.130925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.131091 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.131244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.131396 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.131548 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.131710 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.131872 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.132025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.132184 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.132184 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.132472 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.132623 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.132784 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.132953 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.133112 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.133266 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.133424 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.133582 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.133744 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.133895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.134070 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.134235 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.134396 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.134556 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.134726 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.134726 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.135032 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.135193 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.135352 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.135517 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.135670 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.135828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.135987 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.136139 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.136290 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.136450 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.136612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.136778 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.136930 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.137106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.137258 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.137411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.137561 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.137720 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.137872 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.138084 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.138238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.138416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.139103 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.139273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.139434 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.139609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.139771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.139924 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.140076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.140227 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.140387 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.140553 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.140895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.141058 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.141320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.141475 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.141635 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.141813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.142009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.142177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.142329 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.142489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.142657 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.142809 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.142961 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.143111 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.143262 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.143421 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.143587 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.143748 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.143901 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.144071 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.144223 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.144374 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.144534 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.144686 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.144838 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.144996 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.145156 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.145318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.145470 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.145629 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.145788 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.145996 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.146156 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.146320 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.146481 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.146633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.146793 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.146953 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.147106 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.147266 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.147418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.147570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.147722 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.147874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.148043 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.148205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.148356 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.148508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.148685 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.149374 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.149538 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.149691 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.149691 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.150018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.150185 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.150336 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.150562 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.150734 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.150889 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.151048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.151207 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.151367 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.151529 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.151700 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.151938 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.152109 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.152262 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.152413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.152574 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.152726 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.152887 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.153046 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.153199 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.153359 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.153519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.153671 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.153822 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.154035 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.154195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.154468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.154628 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.154788 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.154950 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.155110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.155270 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.155440 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.155599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.155751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.155909 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.156062 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.156307 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.157014 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.157175 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.157328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.157480 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.157649 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.157815 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.157997 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.157997 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.158292 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.158445 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.158858 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.159475 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.159475 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.159864 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.160018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.160179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.160338 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.160512 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.160665 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.160817 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.160976 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.161135 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.161286 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.161454 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.161610 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.161762 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.161913 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.162122 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.162122 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.162436 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.162589 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.162741 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.162741 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.163035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.163035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.163341 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.163341 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.163647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.163808 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.163969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.164131 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.164291 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.164453 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.164605 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.164757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.164918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.165070 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.165229 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.165393 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.165560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.165714 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.165875 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.166066 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.166220 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.166382 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.166535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.166686 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.166847 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.167007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.167007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.167296 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.167447 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.167612 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.167774 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.167926 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.168078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.168238 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.168389 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.168550 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.168710 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.168864 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.169574 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.169757 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.170027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.170203 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.170356 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.170508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.170659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.170818 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.170992 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.171145 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.171305 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.171467 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.171620 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.171777 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.171943 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.172128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.172812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.172812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.173112 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.173278 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.173451 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.173611 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.173771 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.173923 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.174130 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.174293 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.174459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.174611 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.174769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.174921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.175081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.175242 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.175409 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.175579 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.175732 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.175891 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.176051 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.176214 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.176366 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.176577 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.176734 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.176884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.177035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.177035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.177349 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.177502 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.177663 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.177822 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.178039 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.178212 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.178365 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.178516 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.178673 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.178673 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.178970 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.179468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.179650 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.179888 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.180160 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.180320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.180487 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.180648 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.180808 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.180960 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.181114 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.181272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.181435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.181588 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.181748 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.181900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.182081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.182256 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.182418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.182580 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.182734 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.182885 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.183045 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.183273 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.183435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.183595 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.183756 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.183908 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.183908 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.184228 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.184388 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.184561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.185275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.185438 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.185608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.185770 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.185922 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.186117 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.186281 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.187031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.187207 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.187382 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.187544 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.187699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.187912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.188578 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.188756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.188910 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.189063 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.189214 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.189707 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.189886 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.190165 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.190420 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.190608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.190857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.191027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.191195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.191348 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.191499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.191651 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.191803 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.191962 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.192132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.192291 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.192444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.192444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.192760 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.192913 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.193079 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.193232 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.193382 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.193542 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.193693 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.193861 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.194051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.194217 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.194369 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.194520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.194683 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.194849 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.195002 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.195154 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.195304 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.195468 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.195621 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.195781 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.195932 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.196084 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.196244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.196397 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.196548 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.196548 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.196862 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.197039 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.197641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.197815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.198011 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.198220 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.198378 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.198530 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.198689 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.198842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.199009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.199009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.199320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.199491 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.199989 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.200199 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.200432 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.200694 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.200872 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.201114 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.201280 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.201280 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.201630 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.201790 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.202031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.202192 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.202344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.202511 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.202665 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.202833 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.203034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.203200 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.203395 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.203628 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.203789 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.203968 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.204182 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.204351 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.204506 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.204667 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.204828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.204980 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.205132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.205283 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.205444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.205606 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.205767 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.205918 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.206674 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.206851 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.207019 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.207173 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.207338 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.207491 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.207651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.207812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.207812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.207812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.207812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.207812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.208538 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.208691 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.208867 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.209027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.209186 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.209338 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.209489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.209668 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.210206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.210363 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.210524 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.210705 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.210955 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.211145 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.211384 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.211564 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.211725 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.211895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.212060 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.212222 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.212376 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.212535 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.212535 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.212839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.212999 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.213166 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.213319 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.213489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.213646 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.213807 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.213999 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.214159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.214310 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.214470 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.214622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.214773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.214773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.215071 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.215231 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.215382 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.215544 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.215696 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.215859 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.216013 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.216205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.216361 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.216513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.216678 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.216831 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.216982 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.217141 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.217300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.217462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.217694 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.217849 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.219689 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.220165 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.220403 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.220586 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.220753 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.220916 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.221076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.221230 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.221401 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.221673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.221926 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.222106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.222269 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.222441 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.222594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.222756 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.222909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.223062 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.223213 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.223375 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.223527 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.223693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.223853 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.224023 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.224174 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.224325 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.224486 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.224653 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.224806 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.224959 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.225110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.225262 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.225433 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.225588 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.225749 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.225914 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.226139 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.226302 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.226464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.226626 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.226778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.226930 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.227089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.227241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.227406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.227560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.227710 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.227861 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.228025 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.228193 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.228354 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.228506 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.228658 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.228943 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.228943 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.229257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.229683 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.229854 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.230342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.230641 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.230827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.230996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.231150 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.231302 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.231463 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.231631 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.231947 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.232254 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.232416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.232577 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.232739 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.232901 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.233063 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.233236 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.233391 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.233543 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.233695 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.233857 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.234083 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.234240 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.234401 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.234553 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.234767 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.234926 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.235088 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.235254 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.235407 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.235559 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.235711 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.235876 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.236031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.236182 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.236341 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.236493 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.236644 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.236805 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.236966 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.237127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.237291 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.237443 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.237601 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.237762 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.237762 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.238100 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.238262 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.238416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.238577 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.238730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.238881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.239175 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.239360 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.239515 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.239698 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.239988 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.240167 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.240673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.240950 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.241109 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.241280 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.241444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.241597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.241757 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.241959 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.242309 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.242617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.242785 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.242939 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.243101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.243262 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.243427 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.243581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.243581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.243879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.244040 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.244194 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.244194 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.244512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.245402 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.245577 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.245780 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 06:29:27.246589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.246589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.246589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.246589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.246589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.246589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.246589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.246589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.247786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.247786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.247786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.247786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.247786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.247786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.247786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.247786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.248927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.248927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.248927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.248927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.248927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.248927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.248927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.248927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.251243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.251243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.251243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.251243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.251243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.251243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.251243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.251243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.253113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.253113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.253113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.253113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.253113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.253113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.253113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.253113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.254608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.254608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.254608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.254608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.254608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.254608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 06:29:27.254608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 06:29:27.381715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO dbcounter [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Registered counter for database nova_api Jul 21 06:29:27.399608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO dbcounter [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Registered counter for database nova_api Jul 21 06:29:27.406082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_db.sqlalchemy.engines [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:29:27.413032 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writer thread running {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:29:27.422704 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_db.sqlalchemy.engines [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:29:27.432771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writer thread running {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:29:27.470342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.context [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c4473db-2c5c-4a23-b88a-a9d1173a3dee(cell1) {{(pid=117906) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 06:29:27.474473 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:29:27.476058 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:29:27.476905 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:29:27.478932 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:29:27.480932 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO dbcounter [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Registered counter for database nova_cell0 Jul 21 06:29:27.485601 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO dbcounter [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Registered counter for database nova_cell1 Jul 21 06:29:27.489977 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.context [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c4473db-2c5c-4a23-b88a-a9d1173a3dee(cell1) {{(pid=117905) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 06:29:27.494180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:29:27.495078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_db.sqlalchemy.engines [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:29:27.496018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:29:27.496843 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:29:27.496969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_db.sqlalchemy.engines [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:29:27.498887 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:29:27.501494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO dbcounter [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Registered counter for database nova_cell0 Jul 21 06:29:27.505303 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writer thread running {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:29:27.505577 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO dbcounter [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Registered counter for database nova_cell1 Jul 21 06:29:27.505696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writer thread running {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:29:27.513443 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_db.sqlalchemy.engines [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:29:27.515691 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_db.sqlalchemy.engines [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:29:27.522719 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writer thread running {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:29:27.523974 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writer thread running {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:29:27.654132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO dbcounter [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Registered counter for database nova_cell0 Jul 21 06:29:27.661760 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_db.sqlalchemy.engines [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:29:27.666308 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writer thread running {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:29:27.671071 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO dbcounter [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Registered counter for database nova_cell0 Jul 21 06:29:27.678135 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_db.sqlalchemy.engines [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 06:29:27.682410 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writer thread running {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 06:29:27.993087 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: WARNING keystonemiddleware.auth_token [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 06:29:27.996224 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: WARNING keystonemiddleware.auth_token [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 06:29:28.000512 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: WARNING keystonemiddleware.auth_token [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 06:29:28.003514 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: WARNING keystonemiddleware.auth_token [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 06:29:28.350413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: WARNING keystonemiddleware.auth_token [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 06:29:28.352531 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: WARNING keystonemiddleware.auth_token [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 06:29:28.356340 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: WARNING keystonemiddleware.auth_token [None req-b4af99f6-0a23-49b2-977f-79bcc67ffcd2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 06:29:28.358675 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: WARNING keystonemiddleware.auth_token [None req-aab5b89e-7c2f-48ed-9d42-5cf7c25a0307 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 06:29:28.363171 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff9ccf19c0 pid: 117905 (default app) Jul 21 06:29:28.365338 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff9ccf19c0 pid: 117906 (default app) Jul 21 06:30:13.095269 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f12e678d-3f3e-438f-a9a3-bcf59ad8ad1e tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f9335b91820>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:13.158689 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=3 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:13.163616 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=3 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:13.164511 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=3 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:13.165456 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=3 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:13.970954 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f12e678d-3f3e-438f-a9a3-bcf59ad8ad1e tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4b9d4e1d-70d4-4946-88db-2e82d8b6a04d" status: 200 len: 350 microversion: 2.1 time: 1.544567 Jul 21 06:30:13.972110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 1/1] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:30:12 2022] GET /compute/v2.1/os-volumes/4b9d4e1d-70d4-4946-88db-2e82d8b6a04d => generated 350 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:30:16.258843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b1fe30e4-7b4e-4e5b-be76-d362885dd172 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f9335b94820>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:16.293452 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:16.295274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:16.296471 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:16.297921 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:17.176664 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b1fe30e4-7b4e-4e5b-be76-d362885dd172 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ad4f9ba2-f759-4fa3-8b0f-6f14ccc5c0cf" status: 200 len: 351 microversion: 2.1 time: 1.511228 Jul 21 06:30:17.180442 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:30:15 2022] GET /compute/v2.1/os-volumes/ad4f9ba2-f759-4fa3-8b0f-6f14ccc5c0cf => generated 351 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:30:18.969056 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-98cf5b57-20e6-463d-8c20-bef1c341312a tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f93359e4b80>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:19.084371 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-98cf5b57-20e6-463d-8c20-bef1c341312a tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a7e1241b-9e60-4872-acc5-8e2e439de3b4" status: 200 len: 350 microversion: 2.1 time: 0.120296 Jul 21 06:30:19.085465 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:30:18 2022] GET /compute/v2.1/os-volumes/a7e1241b-9e60-4872-acc5-8e2e439de3b4 => generated 350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:30:19.097188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2732a5cc-6a33-47ee-ae47-abc46cfc50cc tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f93359e4af0>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:19.322044 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2732a5cc-6a33-47ee-ae47-abc46cfc50cc tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.228852 Jul 21 06:30:19.323653 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1133 bytes} [Thu Jul 21 06:30:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:19.346347 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f8e3ed99-f808-49eb-94e1-970c969eead9 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f93359e4dc0>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:19.609106 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f8e3ed99-f808-49eb-94e1-970c969eead9 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.277106 Jul 21 06:30:19.609681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1148 bytes} [Thu Jul 21 06:30:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:30:19.622311 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6f722c36-1146-4a0c-87f2-a011ddd116b0 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f93359ab3a0>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:19.881626 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6f722c36-1146-4a0c-87f2-a011ddd116b0 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.263975 Jul 21 06:30:19.882720 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1133 bytes} [Thu Jul 21 06:30:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:19.895027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-47b9f9a2-05af-46d5-a39d-0100f16fcc0f tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f93359aa790>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:20.082738 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-47b9f9a2-05af-46d5-a39d-0100f16fcc0f tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.191851 Jul 21 06:30:20.092156 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1166 bytes} [Thu Jul 21 06:30:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:30:20.098370 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3878f407-8d9f-4bbd-898e-1146ef426d18 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f93359b9040>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:20.255573 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3878f407-8d9f-4bbd-898e-1146ef426d18 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.162795 Jul 21 06:30:20.256505 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1169 bytes} [Thu Jul 21 06:30:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:30:20.279825 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b7530f4c-0e39-481c-aee7-c62f77eb9891 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f93359aad30>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:20.559135 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b7530f4c-0e39-481c-aee7-c62f77eb9891 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.293558 Jul 21 06:30:20.559848 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1154 bytes} [Thu Jul 21 06:30:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:20.571169 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-385d5fcf-0d32-4c90-b4f9-7769b972d8ac tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f93359abb80>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:20.812858 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-385d5fcf-0d32-4c90-b4f9-7769b972d8ac tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.245461 Jul 21 06:30:20.813840 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 5/10] 10.222.0.42 () {58 vars in 1187 bytes} [Thu Jul 21 06:30:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:30:20.826151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c88d8396-4fb0-4477-89fd-0499f23a7583 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] Calling method '.version_select at 0x7f933633b040>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:21.035116 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c88d8396-4fb0-4477-89fd-0499f23a7583 tempest-VolumesTestJSON-1582129305 tempest-VolumesTestJSON-1582129305-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.213109 Jul 21 06:30:21.035973 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1154 bytes} [Thu Jul 21 06:30:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:23.795238 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2109553005", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:30:24.082615 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] validate_networks() for [('99d9c8f4-68ee-4bd8-aaed-8ace9842a377', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:30:26.780212 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ed47c1a2-849b-4d37-9a8c-98e19dd9aaf3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'create', calling method: .version_select at 0x7f93359e4dc0>, body: {"keypair": {"name": "tempest-keypair-2109656386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZWseLdl5jzdQ87+Bl14ENY2vDuM5BKXpPPZ5IYgZMZEORFz9jet2MbLZ6btTy8AwDxwbssMPENarYIWx1Ac1yE1nW9RAjoujctVGNvbqr7bs1/i/jmwT2IPhvfEwPbFw=="}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:30:26.890037 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-ed47c1a2-849b-4d37-9a8c-98e19dd9aaf3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Getting quotas for project b2843a54fec340e19485e7b821fc071a. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:30:26.908926 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-ed47c1a2-849b-4d37-9a8c-98e19dd9aaf3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Getting quotas for user 8561734cf36e47b5ab2d7242076437ff and project b2843a54fec340e19485e7b821fc071a. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:30:27.023325 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:30:27.023807 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:30:27.024414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:30:27.024897 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:30:27.025410 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:30:27.077241 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ed47c1a2-849b-4d37-9a8c-98e19dd9aaf3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.691638 Jul 21 06:30:27.077992 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 7/12] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 06:30:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:30:27.096579 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:27.097041 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:27.097845 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:27.099719 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:27.178722 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Getting quotas for project 9cd8a1a642a24b519aefdde9ed336536. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:30:27.188771 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Getting quotas for user 774dd66c674a4955a439afd30354efab and project 9cd8a1a642a24b519aefdde9ed336536. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:30:27.209125 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:30:27.224027 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:30:27.344391 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f67bb347-4dd1-4590-a68a-fe2a62089362 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.151011 Jul 21 06:30:27.352961 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 6/13] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:30:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 4160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:30:27.356450 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e14d7c91-7ebe-4bd5-9427-75229e86a432 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:27.357419 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e14d7c91-7ebe-4bd5-9427-75229e86a432 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:27.657208 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e14d7c91-7ebe-4bd5-9427-75229e86a432 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:27.708950 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e14d7c91-7ebe-4bd5-9427-75229e86a432 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1222 microversion: 2.1 time: 0.353213 Jul 21 06:30:27.715177 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 8/14] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:27 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1222 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:28.163977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1741877972", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:30:28.300840 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] validate_networks() for [('99d9c8f4-68ee-4bd8-aaed-8ace9842a377', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:30:32.213171 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:30:32.214496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:30:32.215246 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:30:32.216010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:30:32.216734 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:30:32.256813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:32.261819 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:32.267760 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:32.272972 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:32.387206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Getting quotas for project 9cd8a1a642a24b519aefdde9ed336536. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:30:32.418941 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Getting quotas for user 774dd66c674a4955a439afd30354efab and project 9cd8a1a642a24b519aefdde9ed336536. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:30:32.499537 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:30:32.513915 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:30:32.671725 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-306b706b-33d4-4eaf-a6b2-1a09e88ae0a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.513316 Jul 21 06:30:32.674290 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 7/15] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:30:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 4517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:30:32.693343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-648867ed-0f5c-46b9-8cce-62905d22fd24 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:32.703157 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-648867ed-0f5c-46b9-8cce-62905d22fd24 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:33.043339 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-648867ed-0f5c-46b9-8cce-62905d22fd24 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:33.156707 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-648867ed-0f5c-46b9-8cce-62905d22fd24 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1222 microversion: 2.1 time: 0.477025 Jul 21 06:30:33.160634 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:32 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1222 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:33.694448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-830685020", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "networks": [{"uuid": "dd1d0072-51cc-44a0-b14b-ddac5223cb8f"}]}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:30:34.159662 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.network.neutron [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] validate_networks() for [('dd1d0072-51cc-44a0-b14b-ddac5223cb8f', None, None, None, None, None)] {{(pid=117905) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:30:35.106072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b0992bcb-be35-4450-8c71-ea1f72d64e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: .version_select at 0x7f93350c0ca0>, body: {"keypair": {"name": "tempest-keypair-1053704130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7wEJdp5cMMVlXlr9/EOS0VCZHC9dheFMexQLQ/ZkaZZZMvy+EvBFnGDlvmpRDC+Jex6OFfvYjmRT0yyVRCcCKobdjvFiDdRZoM0HKmqABArsksCSl4Pj9fCvAxrBKg7g=="}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:30:35.208434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-b0992bcb-be35-4450-8c71-ea1f72d64e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:30:35.231556 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-b0992bcb-be35-4450-8c71-ea1f72d64e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for user 5c54ac39faa84c7db5b9b63360216d7b and project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:30:35.372882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b0992bcb-be35-4450-8c71-ea1f72d64e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.200300 Jul 21 06:30:35.377240 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 9/17] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 06:30:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:30:35.392993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-88100bcc-5795-4cea-9bed-0d4532fb92c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:35.395243 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-88100bcc-5795-4cea-9bed-0d4532fb92c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:35.413834 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-88100bcc-5795-4cea-9bed-0d4532fb92c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:35.415144 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-88100bcc-5795-4cea-9bed-0d4532fb92c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:35.418353 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-88100bcc-5795-4cea-9bed-0d4532fb92c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:35.418942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-88100bcc-5795-4cea-9bed-0d4532fb92c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:35.980329 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-88100bcc-5795-4cea-9bed-0d4532fb92c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:36.016309 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-88100bcc-5795-4cea-9bed-0d4532fb92c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1226 microversion: 2.1 time: 0.633168 Jul 21 06:30:36.017256 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 10/18] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:35 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1226 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:36.920386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c448f442-ff71-47e7-8838-1f5876dc3064 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Action: 'create', calling method: .version_select at 0x7f9327ffc820>, body: {"keypair": {"name": "tempest-keypair-1446977107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXZmcQjnx7vUs9Oy6XZeJzxJQd4A0N7KJlhU/n+vedLwQTOXdFpIU+RUXkZMiKGDS92FlmFiq9+X3+YvYSuV5OX1fNPpIuyP+NOzDZx3XjfE9mpOnkCK3KLG4MdPxOb3g=="}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:30:36.980514 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-c448f442-ff71-47e7-8838-1f5876dc3064 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Getting quotas for project 2be6e5aedba545f4b562423c55ddbf80. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:30:36.998340 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-c448f442-ff71-47e7-8838-1f5876dc3064 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Getting quotas for user 15ec5e26839f494e98ec70ac49ebe415 and project 2be6e5aedba545f4b562423c55ddbf80. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:30:37.112568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c448f442-ff71-47e7-8838-1f5876dc3064 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.077948 Jul 21 06:30:37.115448 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 11/19] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Jul 21 06:30:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1081 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 06:30:37.131970 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3dc11d4a-897e-428d-bf0c-22b4a35629b7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:37.133251 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3dc11d4a-897e-428d-bf0c-22b4a35629b7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:37.168082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3dc11d4a-897e-428d-bf0c-22b4a35629b7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:37.168548 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3dc11d4a-897e-428d-bf0c-22b4a35629b7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:37.169360 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3dc11d4a-897e-428d-bf0c-22b4a35629b7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:37.169812 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3dc11d4a-897e-428d-bf0c-22b4a35629b7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:37.539818 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3dc11d4a-897e-428d-bf0c-22b4a35629b7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:37.575636 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3dc11d4a-897e-428d-bf0c-22b4a35629b7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1226 microversion: 2.1 time: 0.444029 Jul 21 06:30:37.590995 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 12/20] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:37 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1226 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:37.606029 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1014385461", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1554b7d-10e2-4dcf-85e9-e6a44388f0b3"}], "security_groups": [{"name": "tempest-securitygroup--28166646"}], "key_name": "tempest-keypair-2109656386", "user_data": "}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:30:37.670723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=6 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:38.451039 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Flavor limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:30:38.451731 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Image limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:30:38.452539 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Flavor pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:30:38.453225 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Image pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:30:38.453807 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:30:38.469032 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] validate_networks() for [('a1554b7d-10e2-4dcf-85e9-e6a44388f0b3', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:30:38.487763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:38.488237 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:38.490007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:38.497004 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:38.630868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Getting quotas for project c743e22f3fdb4a61ad1b8035ac06d15b. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:30:38.668078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Getting quotas for user dfeb642f25484665b7c477cde153162d and project c743e22f3fdb4a61ad1b8035ac06d15b. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:30:38.684328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Going to run 1 instances... {{(pid=117905) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:30:38.700325 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:30:39.039155 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4c39d101-7dcf-4d9c-bddd-e2ad77a4c2ec tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.893702 Jul 21 06:30:39.042572 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 9/21] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 6898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 06:30:39.052872 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8a9448ca-7e05-47bd-b923-3c4b650adeff tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:39.054066 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8a9448ca-7e05-47bd-b923-3c4b650adeff tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:39.078411 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8a9448ca-7e05-47bd-b923-3c4b650adeff tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:39.080395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8a9448ca-7e05-47bd-b923-3c4b650adeff tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:39.083375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8a9448ca-7e05-47bd-b923-3c4b650adeff tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:39.092237 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8a9448ca-7e05-47bd-b923-3c4b650adeff tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:40.919025 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8a9448ca-7e05-47bd-b923-3c4b650adeff tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:41.003275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8a9448ca-7e05-47bd-b923-3c4b650adeff tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1292 microversion: 2.1 time: 1.958797 Jul 21 06:30:41.026462 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 10/22] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:39 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1292 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:41.032338 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-bfd360ef-24d9-42d4-a21d-7bea3ed99a96 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:41.063818 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-bfd360ef-24d9-42d4-a21d-7bea3ed99a96 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:41.092041 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bfd360ef-24d9-42d4-a21d-7bea3ed99a96 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:41.092676 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bfd360ef-24d9-42d4-a21d-7bea3ed99a96 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:41.111975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bfd360ef-24d9-42d4-a21d-7bea3ed99a96 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:41.112457 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bfd360ef-24d9-42d4-a21d-7bea3ed99a96 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:41.520510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bfd360ef-24d9-42d4-a21d-7bea3ed99a96 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:41.543346 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-bfd360ef-24d9-42d4-a21d-7bea3ed99a96 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1218 microversion: 2.1 time: 0.515459 Jul 21 06:30:41.543921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:41 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1218 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:42.022308 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4fc25dbb-db85-4664-8bb6-e52cd5d945e7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:42.023033 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4fc25dbb-db85-4664-8bb6-e52cd5d945e7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:42.034418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4fc25dbb-db85-4664-8bb6-e52cd5d945e7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:42.034757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4fc25dbb-db85-4664-8bb6-e52cd5d945e7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:42.039307 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4fc25dbb-db85-4664-8bb6-e52cd5d945e7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:42.050859 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4fc25dbb-db85-4664-8bb6-e52cd5d945e7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:42.265716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4fc25dbb-db85-4664-8bb6-e52cd5d945e7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:42.279617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4fc25dbb-db85-4664-8bb6-e52cd5d945e7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1280 microversion: 2.1 time: 0.260494 Jul 21 06:30:42.281558 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 12/24] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:42 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1280 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:42.334957 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=4 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:42.517400 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:30:42.518128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:30:42.518990 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:30:42.520939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:30:42.522827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:30:42.557241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:42.558942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:42.568600 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1e20967c-17cc-4e5f-9c09-7b44f967f645 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:42.568968 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:42.569773 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1e20967c-17cc-4e5f-9c09-7b44f967f645 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:42.572868 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:42.590602 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1e20967c-17cc-4e5f-9c09-7b44f967f645 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:42.591487 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1e20967c-17cc-4e5f-9c09-7b44f967f645 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:42.592659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1e20967c-17cc-4e5f-9c09-7b44f967f645 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:42.595025 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1e20967c-17cc-4e5f-9c09-7b44f967f645 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:42.645682 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Getting quotas for project b2843a54fec340e19485e7b821fc071a. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:30:42.657578 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Getting quotas for user 8561734cf36e47b5ab2d7242076437ff and project b2843a54fec340e19485e7b821fc071a. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:30:42.725871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:30:42.739229 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:30:42.880313 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a4ad82d2-e838-4591-99c9-69a45c066a37 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 5.286167 Jul 21 06:30:42.890908 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 13/25] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:30:37 2022] POST /compute/v2.1/servers => generated 400 bytes in 5299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:30:42.897283 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ab8c4ec4-9f6b-4647-9405-5d9da99f4d5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:42.905163 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ab8c4ec4-9f6b-4647-9405-5d9da99f4d5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:42.938753 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1e20967c-17cc-4e5f-9c09-7b44f967f645 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:42.948631 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1e20967c-17cc-4e5f-9c09-7b44f967f645 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1266 microversion: 2.1 time: 0.390688 Jul 21 06:30:42.958899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 13/26] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:42 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:43.105088 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ab8c4ec4-9f6b-4647-9405-5d9da99f4d5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:43.122602 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ab8c4ec4-9f6b-4647-9405-5d9da99f4d5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1238 microversion: 2.1 time: 0.230202 Jul 21 06:30:43.139763 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 14/27] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:42 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1238 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:43.300998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-749bd99f-4b61-496c-8f1d-bae07bd20323 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:43.302225 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-749bd99f-4b61-496c-8f1d-bae07bd20323 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:43.331858 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-749bd99f-4b61-496c-8f1d-bae07bd20323 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:43.332906 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-749bd99f-4b61-496c-8f1d-bae07bd20323 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:43.334182 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-749bd99f-4b61-496c-8f1d-bae07bd20323 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:43.335426 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-749bd99f-4b61-496c-8f1d-bae07bd20323 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:43.520524 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-749bd99f-4b61-496c-8f1d-bae07bd20323 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:43.531313 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-749bd99f-4b61-496c-8f1d-bae07bd20323 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1280 microversion: 2.1 time: 0.236987 Jul 21 06:30:43.542644 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:43 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1280 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:43.966671 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-aa0ea112-3d7e-411f-b251-55e336d119b8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:43.967303 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-aa0ea112-3d7e-411f-b251-55e336d119b8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:43.979740 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aa0ea112-3d7e-411f-b251-55e336d119b8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:43.982282 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aa0ea112-3d7e-411f-b251-55e336d119b8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:43.983389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aa0ea112-3d7e-411f-b251-55e336d119b8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:43.984034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aa0ea112-3d7e-411f-b251-55e336d119b8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:44.141584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-703aeebb-3cdd-4ac5-904f-e738a6adbad3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:44.142856 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-703aeebb-3cdd-4ac5-904f-e738a6adbad3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:44.153331 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-703aeebb-3cdd-4ac5-904f-e738a6adbad3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:44.154195 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-703aeebb-3cdd-4ac5-904f-e738a6adbad3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:44.155141 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-703aeebb-3cdd-4ac5-904f-e738a6adbad3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:44.155767 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-703aeebb-3cdd-4ac5-904f-e738a6adbad3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:44.328621 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-aa0ea112-3d7e-411f-b251-55e336d119b8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:44.338190 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-aa0ea112-3d7e-411f-b251-55e336d119b8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1266 microversion: 2.1 time: 0.376023 Jul 21 06:30:44.339475 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:43 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:44.403779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-703aeebb-3cdd-4ac5-904f-e738a6adbad3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:44.414463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-703aeebb-3cdd-4ac5-904f-e738a6adbad3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1242 microversion: 2.1 time: 0.275865 Jul 21 06:30:44.432255 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 15/30] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:44 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1242 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:44.531797 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-313639310", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fac3a692-b3e2-4555-a0ad-f0227031fd7d"}], "security_groups": [{"name": "tempest-securitygroup--1818958243"}], "key_name": "tempest-keypair-1053704130", "user_data": "}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:30:44.548797 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0e4d0dda-0066-49de-a818-28372a368e77 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:44.549783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0e4d0dda-0066-49de-a818-28372a368e77 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:44.561429 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e4d0dda-0066-49de-a818-28372a368e77 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:44.562617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e4d0dda-0066-49de-a818-28372a368e77 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:44.568756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e4d0dda-0066-49de-a818-28372a368e77 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:44.569526 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e4d0dda-0066-49de-a818-28372a368e77 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:45.180059 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] validate_networks() for [('fac3a692-b3e2-4555-a0ad-f0227031fd7d', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:30:45.525696 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0e4d0dda-0066-49de-a818-28372a368e77 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:45.547193 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0e4d0dda-0066-49de-a818-28372a368e77 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 1.002152 Jul 21 06:30:45.549005 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 16/31] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:44 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:45.556904 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6e88cfe5-9598-4e6a-953f-3f75fbd0539b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:45.557917 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6e88cfe5-9598-4e6a-953f-3f75fbd0539b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:45.573906 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6e88cfe5-9598-4e6a-953f-3f75fbd0539b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:45.574534 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6e88cfe5-9598-4e6a-953f-3f75fbd0539b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:45.575497 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6e88cfe5-9598-4e6a-953f-3f75fbd0539b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:45.576671 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6e88cfe5-9598-4e6a-953f-3f75fbd0539b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:45.868056 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6e88cfe5-9598-4e6a-953f-3f75fbd0539b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:45.882798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6e88cfe5-9598-4e6a-953f-3f75fbd0539b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1266 microversion: 2.1 time: 0.329104 Jul 21 06:30:45.886981 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 17/32] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:45 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:45.909396 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-cc437070-6dd5-43fe-b1c2-6f98ed11ac56 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:45.912499 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-cc437070-6dd5-43fe-b1c2-6f98ed11ac56 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:45.941080 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc437070-6dd5-43fe-b1c2-6f98ed11ac56 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:45.943051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc437070-6dd5-43fe-b1c2-6f98ed11ac56 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:45.947151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc437070-6dd5-43fe-b1c2-6f98ed11ac56 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:45.948521 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc437070-6dd5-43fe-b1c2-6f98ed11ac56 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:46.306799 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-cc437070-6dd5-43fe-b1c2-6f98ed11ac56 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:46.318645 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-cc437070-6dd5-43fe-b1c2-6f98ed11ac56 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1242 microversion: 2.1 time: 0.430075 Jul 21 06:30:46.319412 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 18/33] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:45 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1242 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:46.568479 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-69895a6f-304a-4d04-97e4-5796cdfae0e6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:46.570036 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-69895a6f-304a-4d04-97e4-5796cdfae0e6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:46.581092 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-69895a6f-304a-4d04-97e4-5796cdfae0e6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:46.581555 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-69895a6f-304a-4d04-97e4-5796cdfae0e6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:46.582471 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-69895a6f-304a-4d04-97e4-5796cdfae0e6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:46.582861 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-69895a6f-304a-4d04-97e4-5796cdfae0e6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:46.708279 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:30:46.708794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:30:46.709281 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:30:46.709870 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:30:46.710531 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:30:46.719737 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=11 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:46.740557 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:46.741253 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:46.742371 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:46.743678 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:46.782700 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:30:46.787858 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for user 5c54ac39faa84c7db5b9b63360216d7b and project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:30:46.801727 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:30:46.805633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:30:46.885557 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-03f91144-2b6d-439e-a4a4-6311589bb15a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.364495 Jul 21 06:30:46.886771 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 16/34] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:30:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:30:46.898517 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-32af9e2d-c085-4f9c-88e2-b7351cb63e2e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:46.899374 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-32af9e2d-c085-4f9c-88e2-b7351cb63e2e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:46.913238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-69895a6f-304a-4d04-97e4-5796cdfae0e6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:46.926036 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-69895a6f-304a-4d04-97e4-5796cdfae0e6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.362382 Jul 21 06:30:46.929934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 19/35] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:46 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:46.940699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f43ce1ab-4bbe-48d9-8e1f-94fcf5076ef2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:46.942819 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f43ce1ab-4bbe-48d9-8e1f-94fcf5076ef2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:46.956061 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f43ce1ab-4bbe-48d9-8e1f-94fcf5076ef2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:46.958281 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f43ce1ab-4bbe-48d9-8e1f-94fcf5076ef2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:46.960454 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f43ce1ab-4bbe-48d9-8e1f-94fcf5076ef2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:46.961672 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f43ce1ab-4bbe-48d9-8e1f-94fcf5076ef2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:47.066437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-32af9e2d-c085-4f9c-88e2-b7351cb63e2e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:47.078735 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-32af9e2d-c085-4f9c-88e2-b7351cb63e2e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1241 microversion: 2.1 time: 0.185876 Jul 21 06:30:47.079902 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 17/36] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:46 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:47.092314 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f43ce1ab-4bbe-48d9-8e1f-94fcf5076ef2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:47.103040 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f43ce1ab-4bbe-48d9-8e1f-94fcf5076ef2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1266 microversion: 2.1 time: 0.167188 Jul 21 06:30:47.113897 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 20/37] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:46 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:47.336323 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ee750e9e-a142-454e-af60-97a9a6bc13b3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:47.337408 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ee750e9e-a142-454e-af60-97a9a6bc13b3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:47.353045 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ee750e9e-a142-454e-af60-97a9a6bc13b3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:47.353668 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ee750e9e-a142-454e-af60-97a9a6bc13b3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:47.354634 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ee750e9e-a142-454e-af60-97a9a6bc13b3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:47.355216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ee750e9e-a142-454e-af60-97a9a6bc13b3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:47.497054 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ee750e9e-a142-454e-af60-97a9a6bc13b3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:47.504855 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ee750e9e-a142-454e-af60-97a9a6bc13b3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1242 microversion: 2.1 time: 0.172380 Jul 21 06:30:47.514866 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 18/38] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:47 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1242 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:47.547849 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1386722130", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57bee45f-12cb-4a98-816f-3a63d161af66"}], "security_groups": [{"name": "tempest-securitygroup--989983468"}], "key_name": "tempest-keypair-1446977107", "user_data": "}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:30:47.677116 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.network.neutron [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] validate_networks() for [('57bee45f-12cb-4a98-816f-3a63d161af66', None, None, None, None, None)] {{(pid=117905) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:30:47.948478 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4275f197-1745-4d40-8e62-bfb8428f79cb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:47.949111 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4275f197-1745-4d40-8e62-bfb8428f79cb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:47.971342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4275f197-1745-4d40-8e62-bfb8428f79cb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:47.971824 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4275f197-1745-4d40-8e62-bfb8428f79cb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:47.975600 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4275f197-1745-4d40-8e62-bfb8428f79cb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:47.978273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4275f197-1745-4d40-8e62-bfb8428f79cb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:48.433639 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-4275f197-1745-4d40-8e62-bfb8428f79cb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:48.447386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4275f197-1745-4d40-8e62-bfb8428f79cb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.504530 Jul 21 06:30:48.450035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 19/39] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:47 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:48.465060 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e9c27a4c-211c-437b-ae48-c881e09131b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:48.467337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e9c27a4c-211c-437b-ae48-c881e09131b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:48.488065 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9c27a4c-211c-437b-ae48-c881e09131b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:48.488787 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9c27a4c-211c-437b-ae48-c881e09131b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:48.489899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9c27a4c-211c-437b-ae48-c881e09131b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:48.490382 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9c27a4c-211c-437b-ae48-c881e09131b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:48.568529 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:48.599385 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e9c27a4c-211c-437b-ae48-c881e09131b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:48.610981 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e9c27a4c-211c-437b-ae48-c881e09131b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1245 microversion: 2.1 time: 0.159071 Jul 21 06:30:48.622050 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:48 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1245 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:48.634237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7c82c76b-2b5a-4fd7-ba3e-ffbbb0bbe22a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:48.635341 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7c82c76b-2b5a-4fd7-ba3e-ffbbb0bbe22a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:48.650577 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7c82c76b-2b5a-4fd7-ba3e-ffbbb0bbe22a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:48.651042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7c82c76b-2b5a-4fd7-ba3e-ffbbb0bbe22a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:48.651844 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7c82c76b-2b5a-4fd7-ba3e-ffbbb0bbe22a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:48.652289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7c82c76b-2b5a-4fd7-ba3e-ffbbb0bbe22a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:48.679419 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=6 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:48.717429 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Flavor limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:30:48.717783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Image limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:30:48.719084 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Flavor pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:30:48.719514 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Image pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:30:48.719939 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:30:48.738066 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:48.746422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:48.746975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:48.747432 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:48.800710 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Getting quotas for project 2be6e5aedba545f4b562423c55ddbf80. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:30:48.820732 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Getting quotas for user 15ec5e26839f494e98ec70ac49ebe415 and project 2be6e5aedba545f4b562423c55ddbf80. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:30:48.848600 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7c82c76b-2b5a-4fd7-ba3e-ffbbb0bbe22a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:48.855252 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Going to run 1 instances... {{(pid=117905) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:30:48.857514 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:30:48.870327 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7c82c76b-2b5a-4fd7-ba3e-ffbbb0bbe22a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1266 microversion: 2.1 time: 0.255761 Jul 21 06:30:48.872010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 21/41] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:48 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:48.904259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a48178ce-6601-46b6-ab87-06d87092c304 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:48.905477 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a48178ce-6601-46b6-ab87-06d87092c304 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:48.932224 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a48178ce-6601-46b6-ab87-06d87092c304 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:48.938744 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a48178ce-6601-46b6-ab87-06d87092c304 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:48.943193 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a48178ce-6601-46b6-ab87-06d87092c304 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:48.945441 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a48178ce-6601-46b6-ab87-06d87092c304 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:48.973473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-38843271-61b5-49e7-9542-da6ed20d7499 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.430367 Jul 21 06:30:48.982645 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 21/42] 10.222.0.42 () {62 vars in 1187 bytes} [Thu Jul 21 06:30:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 06:30:48.998284 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7eb1866f-25c5-48f8-bef0-b716900e0a3f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:49.000564 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7eb1866f-25c5-48f8-bef0-b716900e0a3f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:49.139030 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a48178ce-6601-46b6-ab87-06d87092c304 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:49.184983 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a48178ce-6601-46b6-ab87-06d87092c304 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1242 microversion: 2.1 time: 0.311692 Jul 21 06:30:49.193496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 22/43] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:48 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1242 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:49.260832 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7eb1866f-25c5-48f8-bef0-b716900e0a3f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:49.269436 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7eb1866f-25c5-48f8-bef0-b716900e0a3f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:49.277275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7eb1866f-25c5-48f8-bef0-b716900e0a3f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:49.279028 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7eb1866f-25c5-48f8-bef0-b716900e0a3f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1282 microversion: 2.20 time: 0.290051 Jul 21 06:30:49.282241 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:30:48 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1282 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:30:49.485407 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-acd72a76-4c74-47e4-b504-c32235f2ce46 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:49.486388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-acd72a76-4c74-47e4-b504-c32235f2ce46 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:49.505028 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-acd72a76-4c74-47e4-b504-c32235f2ce46 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:49.505603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-acd72a76-4c74-47e4-b504-c32235f2ce46 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:49.510163 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-acd72a76-4c74-47e4-b504-c32235f2ce46 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:49.512205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-acd72a76-4c74-47e4-b504-c32235f2ce46 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:49.632684 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6560d08d-225d-4e9d-947c-68d00c7d54d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:49.633350 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6560d08d-225d-4e9d-947c-68d00c7d54d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:49.646095 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6560d08d-225d-4e9d-947c-68d00c7d54d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:49.647870 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6560d08d-225d-4e9d-947c-68d00c7d54d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:49.650832 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6560d08d-225d-4e9d-947c-68d00c7d54d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:49.656413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6560d08d-225d-4e9d-947c-68d00c7d54d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:49.803551 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6560d08d-225d-4e9d-947c-68d00c7d54d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:49.816966 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6560d08d-225d-4e9d-947c-68d00c7d54d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1237 microversion: 2.1 time: 0.188120 Jul 21 06:30:49.826797 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 23/45] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:49 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1237 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:49.867482 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-acd72a76-4c74-47e4-b504-c32235f2ce46 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:49.876799 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-acd72a76-4c74-47e4-b504-c32235f2ce46 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.400475 Jul 21 06:30:49.878797 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 23/46] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:49 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:49.891587 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-df083919-f767-473b-9a85-576311612502 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:49.892943 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-df083919-f767-473b-9a85-576311612502 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:49.900627 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df083919-f767-473b-9a85-576311612502 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:49.901200 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df083919-f767-473b-9a85-576311612502 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:49.902138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df083919-f767-473b-9a85-576311612502 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:49.902937 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df083919-f767-473b-9a85-576311612502 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:50.003574 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-df083919-f767-473b-9a85-576311612502 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:50.017459 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-df083919-f767-473b-9a85-576311612502 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1274 microversion: 2.1 time: 0.131382 Jul 21 06:30:50.018090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 24/47] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:49 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:50.206254 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c721e866-7b4f-4a6f-a4aa-90538df1c6b5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:50.207232 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c721e866-7b4f-4a6f-a4aa-90538df1c6b5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:50.214443 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c721e866-7b4f-4a6f-a4aa-90538df1c6b5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:50.214919 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c721e866-7b4f-4a6f-a4aa-90538df1c6b5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:50.215994 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c721e866-7b4f-4a6f-a4aa-90538df1c6b5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:50.216636 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c721e866-7b4f-4a6f-a4aa-90538df1c6b5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:50.300296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e57b579e-4566-4878-8709-f23f3f4670ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:50.300876 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e57b579e-4566-4878-8709-f23f3f4670ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:50.312689 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e57b579e-4566-4878-8709-f23f3f4670ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:50.313151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e57b579e-4566-4878-8709-f23f3f4670ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:50.313981 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e57b579e-4566-4878-8709-f23f3f4670ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:50.314405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e57b579e-4566-4878-8709-f23f3f4670ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:50.322898 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c721e866-7b4f-4a6f-a4aa-90538df1c6b5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:50.334164 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c721e866-7b4f-4a6f-a4aa-90538df1c6b5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1234 microversion: 2.1 time: 0.135604 Jul 21 06:30:50.334761 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:50 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1234 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:50.424991 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e57b579e-4566-4878-8709-f23f3f4670ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:50.447401 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e57b579e-4566-4878-8709-f23f3f4670ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:50.450814 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e57b579e-4566-4878-8709-f23f3f4670ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:50.451972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e57b579e-4566-4878-8709-f23f3f4670ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1286 microversion: 2.20 time: 0.156211 Jul 21 06:30:50.454571 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:30:50 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:30:50.838160 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-668fe5e2-6a0f-4b05-97ed-ff4582c5405a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:50.838700 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-668fe5e2-6a0f-4b05-97ed-ff4582c5405a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:50.847143 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-668fe5e2-6a0f-4b05-97ed-ff4582c5405a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:50.847717 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-668fe5e2-6a0f-4b05-97ed-ff4582c5405a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:50.848603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-668fe5e2-6a0f-4b05-97ed-ff4582c5405a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:50.849194 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-668fe5e2-6a0f-4b05-97ed-ff4582c5405a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:50.896032 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6fb55b1c-fbeb-4920-8f1f-5e9a65d6e26e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:50.896770 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6fb55b1c-fbeb-4920-8f1f-5e9a65d6e26e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:50.913762 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6fb55b1c-fbeb-4920-8f1f-5e9a65d6e26e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:50.914623 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6fb55b1c-fbeb-4920-8f1f-5e9a65d6e26e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:50.916450 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6fb55b1c-fbeb-4920-8f1f-5e9a65d6e26e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:50.917121 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6fb55b1c-fbeb-4920-8f1f-5e9a65d6e26e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:51.193322 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-668fe5e2-6a0f-4b05-97ed-ff4582c5405a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:51.213477 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-668fe5e2-6a0f-4b05-97ed-ff4582c5405a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1237 microversion: 2.1 time: 0.380809 Jul 21 06:30:51.215031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 25/50] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:50 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1237 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:51.221363 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4655570c-2d1c-41be-9b0c-4b95f603c70e tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:51.222197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4655570c-2d1c-41be-9b0c-4b95f603c70e tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:51.234493 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4655570c-2d1c-41be-9b0c-4b95f603c70e tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:51.235165 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4655570c-2d1c-41be-9b0c-4b95f603c70e tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:51.237258 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4655570c-2d1c-41be-9b0c-4b95f603c70e tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:51.238439 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4655570c-2d1c-41be-9b0c-4b95f603c70e tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:51.328597 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-4655570c-2d1c-41be-9b0c-4b95f603c70e tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:51.334964 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6fb55b1c-fbeb-4920-8f1f-5e9a65d6e26e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:51.340195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4655570c-2d1c-41be-9b0c-4b95f603c70e tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1274 microversion: 2.1 time: 0.123826 Jul 21 06:30:51.340993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 26/51] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:51 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:51.344077 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6fb55b1c-fbeb-4920-8f1f-5e9a65d6e26e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.452293 Jul 21 06:30:51.344769 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 26/52] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:50 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:51.360336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3bb3e1ed-475c-421a-8730-01a8207660cf tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:51.361178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3bb3e1ed-475c-421a-8730-01a8207660cf tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:51.367429 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3bb3e1ed-475c-421a-8730-01a8207660cf tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:51.369169 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3bb3e1ed-475c-421a-8730-01a8207660cf tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:51.369973 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3bb3e1ed-475c-421a-8730-01a8207660cf tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:51.370596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3bb3e1ed-475c-421a-8730-01a8207660cf tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:51.439172 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3bb3e1ed-475c-421a-8730-01a8207660cf tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:51.448156 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3bb3e1ed-475c-421a-8730-01a8207660cf tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1234 microversion: 2.1 time: 0.091783 Jul 21 06:30:51.448852 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 27/53] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:51 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1234 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:51.472778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-aa828352-cfbd-417e-9185-ce682b523c28 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:51.473395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-aa828352-cfbd-417e-9185-ce682b523c28 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:51.479893 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aa828352-cfbd-417e-9185-ce682b523c28 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:51.480344 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aa828352-cfbd-417e-9185-ce682b523c28 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:51.481290 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aa828352-cfbd-417e-9185-ce682b523c28 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:51.481724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aa828352-cfbd-417e-9185-ce682b523c28 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:51.552097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-aa828352-cfbd-417e-9185-ce682b523c28 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:51.556443 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:51.565704 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-aa828352-cfbd-417e-9185-ce682b523c28 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:51.567924 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-aa828352-cfbd-417e-9185-ce682b523c28 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:51.569083 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-aa828352-cfbd-417e-9185-ce682b523c28 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1286 microversion: 2.20 time: 0.100197 Jul 21 06:30:51.569642 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 27/54] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:30:51 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:30:52.232506 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a16eadcb-f33b-4159-8f4a-13456b8349c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:52.234230 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a16eadcb-f33b-4159-8f4a-13456b8349c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:52.242228 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a16eadcb-f33b-4159-8f4a-13456b8349c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:52.243806 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a16eadcb-f33b-4159-8f4a-13456b8349c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:52.245253 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a16eadcb-f33b-4159-8f4a-13456b8349c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:52.245886 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a16eadcb-f33b-4159-8f4a-13456b8349c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:52.316760 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a16eadcb-f33b-4159-8f4a-13456b8349c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:52.330673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a16eadcb-f33b-4159-8f4a-13456b8349c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1237 microversion: 2.1 time: 0.103392 Jul 21 06:30:52.331245 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 28/55] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:52 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1237 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:52.362086 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-95edc4a9-0acf-4a5c-acc8-eab5ccb8ed30 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:52.362670 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dd39ed3b-3c3c-4fbb-82e8-12414f596b1a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:52.362842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-95edc4a9-0acf-4a5c-acc8-eab5ccb8ed30 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:52.363839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dd39ed3b-3c3c-4fbb-82e8-12414f596b1a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:52.372712 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd39ed3b-3c3c-4fbb-82e8-12414f596b1a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:52.373649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd39ed3b-3c3c-4fbb-82e8-12414f596b1a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:52.374628 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd39ed3b-3c3c-4fbb-82e8-12414f596b1a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:52.375235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd39ed3b-3c3c-4fbb-82e8-12414f596b1a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:52.376661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95edc4a9-0acf-4a5c-acc8-eab5ccb8ed30 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:52.379815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95edc4a9-0acf-4a5c-acc8-eab5ccb8ed30 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:52.380692 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95edc4a9-0acf-4a5c-acc8-eab5ccb8ed30 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:52.382239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95edc4a9-0acf-4a5c-acc8-eab5ccb8ed30 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:52.519249 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-95edc4a9-0acf-4a5c-acc8-eab5ccb8ed30 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:52.529904 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-95edc4a9-0acf-4a5c-acc8-eab5ccb8ed30 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1274 microversion: 2.1 time: 0.172338 Jul 21 06:30:52.542303 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 28/56] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:52 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:52.547203 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-514817bb-283e-4813-a97c-e371d8fb4872 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:52.547853 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-514817bb-283e-4813-a97c-e371d8fb4872 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:52.554024 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-514817bb-283e-4813-a97c-e371d8fb4872 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:52.554480 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-514817bb-283e-4813-a97c-e371d8fb4872 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:52.555792 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-514817bb-283e-4813-a97c-e371d8fb4872 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:52.563301 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-514817bb-283e-4813-a97c-e371d8fb4872 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:52.644601 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dd39ed3b-3c3c-4fbb-82e8-12414f596b1a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:52.654476 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dd39ed3b-3c3c-4fbb-82e8-12414f596b1a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.297068 Jul 21 06:30:52.662106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 29/57] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:52 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:52.673056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-17cddc04-808f-4376-bf81-4e792ed8371f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:52.675308 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-17cddc04-808f-4376-bf81-4e792ed8371f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:52.712093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-17cddc04-808f-4376-bf81-4e792ed8371f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:52.714291 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-17cddc04-808f-4376-bf81-4e792ed8371f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:52.715154 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-17cddc04-808f-4376-bf81-4e792ed8371f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:52.715593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-17cddc04-808f-4376-bf81-4e792ed8371f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:52.766095 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-514817bb-283e-4813-a97c-e371d8fb4872 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:52.779545 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-514817bb-283e-4813-a97c-e371d8fb4872 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1234 microversion: 2.1 time: 0.233804 Jul 21 06:30:52.783515 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 29/58] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:52 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1234 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:52.786947 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:52.874416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-17cddc04-808f-4376-bf81-4e792ed8371f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:52.884010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-17cddc04-808f-4376-bf81-4e792ed8371f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:52.886113 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-17cddc04-808f-4376-bf81-4e792ed8371f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:52.888002 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-17cddc04-808f-4376-bf81-4e792ed8371f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1286 microversion: 2.20 time: 0.224574 Jul 21 06:30:52.888866 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 30/59] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:30:52 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1286 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:30:53.347483 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b9434766-bbdb-4dc8-977f-0010a10a9484 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:53.348095 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b9434766-bbdb-4dc8-977f-0010a10a9484 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:53.362514 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9434766-bbdb-4dc8-977f-0010a10a9484 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:53.364866 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9434766-bbdb-4dc8-977f-0010a10a9484 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:53.370457 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9434766-bbdb-4dc8-977f-0010a10a9484 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:53.371104 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9434766-bbdb-4dc8-977f-0010a10a9484 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:53.463687 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b9434766-bbdb-4dc8-977f-0010a10a9484 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:53.476564 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b9434766-bbdb-4dc8-977f-0010a10a9484 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1237 microversion: 2.1 time: 0.132258 Jul 21 06:30:53.488519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 30/60] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:53 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1237 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:53.551062 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-fc62ec6e-d9d5-41e3-b63f-8e203c3e00fa tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:53.552354 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-fc62ec6e-d9d5-41e3-b63f-8e203c3e00fa tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:53.559634 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fc62ec6e-d9d5-41e3-b63f-8e203c3e00fa tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:53.560088 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fc62ec6e-d9d5-41e3-b63f-8e203c3e00fa tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:53.561114 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fc62ec6e-d9d5-41e3-b63f-8e203c3e00fa tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:53.561623 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fc62ec6e-d9d5-41e3-b63f-8e203c3e00fa tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:53.675319 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fc62ec6e-d9d5-41e3-b63f-8e203c3e00fa tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:53.675834 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9c020da0-9f60-48ff-89a0-4d005a4fef0e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:53.676661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9c020da0-9f60-48ff-89a0-4d005a4fef0e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:53.686152 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c020da0-9f60-48ff-89a0-4d005a4fef0e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:53.686936 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c020da0-9f60-48ff-89a0-4d005a4fef0e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:53.688137 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c020da0-9f60-48ff-89a0-4d005a4fef0e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:53.688765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c020da0-9f60-48ff-89a0-4d005a4fef0e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:53.696631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-fc62ec6e-d9d5-41e3-b63f-8e203c3e00fa tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1274 microversion: 2.1 time: 0.143273 Jul 21 06:30:53.696631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 31/61] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:53 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1274 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:53.798492 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c07fccae-351b-486c-9418-10e5bbeb591f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:53.799108 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c07fccae-351b-486c-9418-10e5bbeb591f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:53.809195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c07fccae-351b-486c-9418-10e5bbeb591f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:53.809655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c07fccae-351b-486c-9418-10e5bbeb591f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:53.810636 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c07fccae-351b-486c-9418-10e5bbeb591f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:53.811208 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c07fccae-351b-486c-9418-10e5bbeb591f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:53.903732 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c07fccae-351b-486c-9418-10e5bbeb591f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:53.931723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c07fccae-351b-486c-9418-10e5bbeb591f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1234 microversion: 2.1 time: 0.131853 Jul 21 06:30:53.932736 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 32/62] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:53 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1234 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:53.947647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-18693fa0-a56d-4f21-b1df-aa5eb0318c60 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:53.948940 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-18693fa0-a56d-4f21-b1df-aa5eb0318c60 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:53.956982 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18693fa0-a56d-4f21-b1df-aa5eb0318c60 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:53.957904 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18693fa0-a56d-4f21-b1df-aa5eb0318c60 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:53.959576 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18693fa0-a56d-4f21-b1df-aa5eb0318c60 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:53.959794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9c020da0-9f60-48ff-89a0-4d005a4fef0e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:53.960568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18693fa0-a56d-4f21-b1df-aa5eb0318c60 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:53.969663 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9c020da0-9f60-48ff-89a0-4d005a4fef0e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.297690 Jul 21 06:30:53.970890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 31/63] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:53 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:54.044910 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-18693fa0-a56d-4f21-b1df-aa5eb0318c60 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:54.065860 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-18693fa0-a56d-4f21-b1df-aa5eb0318c60 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:54.067406 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-18693fa0-a56d-4f21-b1df-aa5eb0318c60 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:54.068546 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-18693fa0-a56d-4f21-b1df-aa5eb0318c60 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1286 microversion: 2.20 time: 0.134466 Jul 21 06:30:54.069104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:30:53 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1286 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:30:54.495986 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c7aa3a77-65e3-4ad0-9633-b06670d07676 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:54.496674 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c7aa3a77-65e3-4ad0-9633-b06670d07676 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:54.503598 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c7aa3a77-65e3-4ad0-9633-b06670d07676 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:54.504100 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c7aa3a77-65e3-4ad0-9633-b06670d07676 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:54.505567 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c7aa3a77-65e3-4ad0-9633-b06670d07676 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:54.506231 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c7aa3a77-65e3-4ad0-9633-b06670d07676 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:54.599761 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c7aa3a77-65e3-4ad0-9633-b06670d07676 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:54.608830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c7aa3a77-65e3-4ad0-9633-b06670d07676 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1237 microversion: 2.1 time: 0.117565 Jul 21 06:30:54.609416 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 32/65] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:54 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1237 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:54.709897 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d226965e-f5d4-4109-b50c-12592d740729 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:54.711180 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d226965e-f5d4-4109-b50c-12592d740729 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:54.719325 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d226965e-f5d4-4109-b50c-12592d740729 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:54.720218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d226965e-f5d4-4109-b50c-12592d740729 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:54.721462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d226965e-f5d4-4109-b50c-12592d740729 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:54.722453 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d226965e-f5d4-4109-b50c-12592d740729 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:54.797083 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d226965e-f5d4-4109-b50c-12592d740729 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:54.813840 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d226965e-f5d4-4109-b50c-12592d740729 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1274 microversion: 2.1 time: 0.109028 Jul 21 06:30:54.814470 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 34/66] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:54 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:54.950448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a5182306-3dc0-49cb-a844-25c8b2464759 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:54.951059 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a5182306-3dc0-49cb-a844-25c8b2464759 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:54.957352 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a5182306-3dc0-49cb-a844-25c8b2464759 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:54.968240 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a5182306-3dc0-49cb-a844-25c8b2464759 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:54.969245 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a5182306-3dc0-49cb-a844-25c8b2464759 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:54.969693 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a5182306-3dc0-49cb-a844-25c8b2464759 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:54.987051 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4b6a4340-b1d2-47ad-9be2-496be11fdec5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:54.988114 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4b6a4340-b1d2-47ad-9be2-496be11fdec5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:54.997542 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4b6a4340-b1d2-47ad-9be2-496be11fdec5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:54.998399 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4b6a4340-b1d2-47ad-9be2-496be11fdec5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:54.999479 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4b6a4340-b1d2-47ad-9be2-496be11fdec5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:54.999974 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4b6a4340-b1d2-47ad-9be2-496be11fdec5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:55.085006 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a5182306-3dc0-49cb-a844-25c8b2464759 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:55.093510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a5182306-3dc0-49cb-a844-25c8b2464759 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1234 microversion: 2.1 time: 0.148366 Jul 21 06:30:55.094800 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 33/67] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:54 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1234 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:55.108428 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-039b970c-71f7-4d7b-9aed-53c11c6ce789 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:55.109228 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-039b970c-71f7-4d7b-9aed-53c11c6ce789 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:55.112288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:55.116659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-039b970c-71f7-4d7b-9aed-53c11c6ce789 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:55.117196 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-039b970c-71f7-4d7b-9aed-53c11c6ce789 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:55.118984 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-039b970c-71f7-4d7b-9aed-53c11c6ce789 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:55.119496 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-039b970c-71f7-4d7b-9aed-53c11c6ce789 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:55.206048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-039b970c-71f7-4d7b-9aed-53c11c6ce789 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:55.213472 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-4b6a4340-b1d2-47ad-9be2-496be11fdec5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:55.215755 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-039b970c-71f7-4d7b-9aed-53c11c6ce789 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:55.217308 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-039b970c-71f7-4d7b-9aed-53c11c6ce789 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:55.218437 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-039b970c-71f7-4d7b-9aed-53c11c6ce789 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1286 microversion: 2.20 time: 0.122400 Jul 21 06:30:55.219007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:30:55 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:30:55.220840 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4b6a4340-b1d2-47ad-9be2-496be11fdec5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.237727 Jul 21 06:30:55.221402 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 35/69] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:54 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:55.625744 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-27a6da37-6e87-423f-8b38-4c947ba948e1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:55.626282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-27a6da37-6e87-423f-8b38-4c947ba948e1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:55.634225 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-27a6da37-6e87-423f-8b38-4c947ba948e1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:55.634225 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-27a6da37-6e87-423f-8b38-4c947ba948e1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:55.634953 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-27a6da37-6e87-423f-8b38-4c947ba948e1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:55.634953 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-27a6da37-6e87-423f-8b38-4c947ba948e1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:55.696028 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-27a6da37-6e87-423f-8b38-4c947ba948e1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:55.703744 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-27a6da37-6e87-423f-8b38-4c947ba948e1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1237 microversion: 2.1 time: 0.081964 Jul 21 06:30:55.704386 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 35/70] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:55 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:55.831724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8d735fe9-44f9-4a46-9a10-25c0b1859044 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:55.832340 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8d735fe9-44f9-4a46-9a10-25c0b1859044 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:55.839011 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d735fe9-44f9-4a46-9a10-25c0b1859044 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:55.839455 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d735fe9-44f9-4a46-9a10-25c0b1859044 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:55.840217 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d735fe9-44f9-4a46-9a10-25c0b1859044 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:55.840644 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d735fe9-44f9-4a46-9a10-25c0b1859044 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:55.903369 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8d735fe9-44f9-4a46-9a10-25c0b1859044 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:55.911703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8d735fe9-44f9-4a46-9a10-25c0b1859044 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1274 microversion: 2.1 time: 0.083762 Jul 21 06:30:55.912262 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 36/71] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:55 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:56.111886 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8ca075db-0c65-4cf9-af49-65b9e8a5abd9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:56.112503 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8ca075db-0c65-4cf9-af49-65b9e8a5abd9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:56.118522 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8ca075db-0c65-4cf9-af49-65b9e8a5abd9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:56.118963 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8ca075db-0c65-4cf9-af49-65b9e8a5abd9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:56.119722 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8ca075db-0c65-4cf9-af49-65b9e8a5abd9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:56.120164 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8ca075db-0c65-4cf9-af49-65b9e8a5abd9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:56.186592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8ca075db-0c65-4cf9-af49-65b9e8a5abd9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:56.193993 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8ca075db-0c65-4cf9-af49-65b9e8a5abd9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1234 microversion: 2.1 time: 0.086097 Jul 21 06:30:56.194556 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 36/72] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:56 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1234 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:56.237324 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-445b0a26-3107-4489-82fc-104b1581d787 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:56.237929 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-445b0a26-3107-4489-82fc-104b1581d787 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:56.238084 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a79eefa8-0c4a-4b1d-bf99-fd0b44d5832b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:56.238613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a79eefa8-0c4a-4b1d-bf99-fd0b44d5832b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:56.244539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-445b0a26-3107-4489-82fc-104b1581d787 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:56.244985 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-445b0a26-3107-4489-82fc-104b1581d787 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:56.245445 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a79eefa8-0c4a-4b1d-bf99-fd0b44d5832b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:56.245762 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-445b0a26-3107-4489-82fc-104b1581d787 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:56.245887 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a79eefa8-0c4a-4b1d-bf99-fd0b44d5832b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:56.246202 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-445b0a26-3107-4489-82fc-104b1581d787 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:56.246670 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a79eefa8-0c4a-4b1d-bf99-fd0b44d5832b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:56.248278 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a79eefa8-0c4a-4b1d-bf99-fd0b44d5832b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:56.330649 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a79eefa8-0c4a-4b1d-bf99-fd0b44d5832b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:56.339203 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a79eefa8-0c4a-4b1d-bf99-fd0b44d5832b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:56.340720 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a79eefa8-0c4a-4b1d-bf99-fd0b44d5832b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:56.341815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a79eefa8-0c4a-4b1d-bf99-fd0b44d5832b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1286 microversion: 2.20 time: 0.107601 Jul 21 06:30:56.342409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 37/73] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:30:56 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:30:56.396580 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-445b0a26-3107-4489-82fc-104b1581d787 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:56.404748 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-445b0a26-3107-4489-82fc-104b1581d787 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.171318 Jul 21 06:30:56.405318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 37/74] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:56 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:56.720451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3c358005-1d7e-4e92-b69c-d3c07a290287 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:56.721086 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3c358005-1d7e-4e92-b69c-d3c07a290287 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:56.727650 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3c358005-1d7e-4e92-b69c-d3c07a290287 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:56.728128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3c358005-1d7e-4e92-b69c-d3c07a290287 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:56.728891 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3c358005-1d7e-4e92-b69c-d3c07a290287 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:56.729328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3c358005-1d7e-4e92-b69c-d3c07a290287 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:56.793018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3c358005-1d7e-4e92-b69c-d3c07a290287 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:56.800375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3c358005-1d7e-4e92-b69c-d3c07a290287 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1237 microversion: 2.1 time: 0.083760 Jul 21 06:30:56.800954 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 38/75] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:56 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:56.928095 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6a1377ca-090e-4fd6-a693-da991b74742a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:56.928650 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6a1377ca-090e-4fd6-a693-da991b74742a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:56.931028 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=4 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:56.936504 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6a1377ca-090e-4fd6-a693-da991b74742a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:56.936945 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6a1377ca-090e-4fd6-a693-da991b74742a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:56.937697 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6a1377ca-090e-4fd6-a693-da991b74742a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:56.938157 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6a1377ca-090e-4fd6-a693-da991b74742a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:56.999787 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6a1377ca-090e-4fd6-a693-da991b74742a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:57.009803 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6a1377ca-090e-4fd6-a693-da991b74742a tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1274 microversion: 2.1 time: 0.085501 Jul 21 06:30:57.018853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 38/76] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:56 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:57.210515 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-96887b3f-e9cd-410d-86e8-de36a05edce8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:57.211082 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-96887b3f-e9cd-410d-86e8-de36a05edce8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:57.217139 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96887b3f-e9cd-410d-86e8-de36a05edce8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:57.217575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96887b3f-e9cd-410d-86e8-de36a05edce8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:57.218378 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96887b3f-e9cd-410d-86e8-de36a05edce8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:57.218817 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96887b3f-e9cd-410d-86e8-de36a05edce8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:57.287604 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-96887b3f-e9cd-410d-86e8-de36a05edce8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:57.296746 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-96887b3f-e9cd-410d-86e8-de36a05edce8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1234 microversion: 2.1 time: 0.090027 Jul 21 06:30:57.297352 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 39/77] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:57 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:57.360759 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-da540dfa-91bc-4ee9-b314-41b341e77c62 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:57.361358 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-da540dfa-91bc-4ee9-b314-41b341e77c62 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:57.363185 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=38 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:57.369377 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-da540dfa-91bc-4ee9-b314-41b341e77c62 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:57.369837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-da540dfa-91bc-4ee9-b314-41b341e77c62 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:57.370889 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-da540dfa-91bc-4ee9-b314-41b341e77c62 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:57.371366 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-da540dfa-91bc-4ee9-b314-41b341e77c62 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:57.421621 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0ce89096-31bc-4d63-9976-d70a1f96b87f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:57.422271 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0ce89096-31bc-4d63-9976-d70a1f96b87f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:57.428328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0ce89096-31bc-4d63-9976-d70a1f96b87f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:57.428780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0ce89096-31bc-4d63-9976-d70a1f96b87f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:57.429588 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0ce89096-31bc-4d63-9976-d70a1f96b87f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:57.430779 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-da540dfa-91bc-4ee9-b314-41b341e77c62 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:57.430914 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0ce89096-31bc-4d63-9976-d70a1f96b87f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:57.438798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-da540dfa-91bc-4ee9-b314-41b341e77c62 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:57.440292 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-da540dfa-91bc-4ee9-b314-41b341e77c62 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:57.441418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-da540dfa-91bc-4ee9-b314-41b341e77c62 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1286 microversion: 2.20 time: 0.084488 Jul 21 06:30:57.441992 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 39/78] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:30:57 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:30:57.558977 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0ce89096-31bc-4d63-9976-d70a1f96b87f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:57.566399 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0ce89096-31bc-4d63-9976-d70a1f96b87f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.148634 Jul 21 06:30:57.566971 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 40/79] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:57 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:57.816733 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-195a96e7-6f5b-49d7-869a-363ae35c2d50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:57.817264 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-195a96e7-6f5b-49d7-869a-363ae35c2d50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:57.823822 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-195a96e7-6f5b-49d7-869a-363ae35c2d50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:57.824264 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-195a96e7-6f5b-49d7-869a-363ae35c2d50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:57.825016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-195a96e7-6f5b-49d7-869a-363ae35c2d50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:57.825444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-195a96e7-6f5b-49d7-869a-363ae35c2d50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:57.887170 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-195a96e7-6f5b-49d7-869a-363ae35c2d50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:57.894489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-195a96e7-6f5b-49d7-869a-363ae35c2d50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1237 microversion: 2.1 time: 0.081771 Jul 21 06:30:57.895049 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 40/80] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:57 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:58.026709 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-dfc1279d-62d0-4041-b140-8a7f1b5524e2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:58.027559 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-dfc1279d-62d0-4041-b140-8a7f1b5524e2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:58.033537 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dfc1279d-62d0-4041-b140-8a7f1b5524e2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:58.034020 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dfc1279d-62d0-4041-b140-8a7f1b5524e2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:58.034801 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dfc1279d-62d0-4041-b140-8a7f1b5524e2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:58.035291 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dfc1279d-62d0-4041-b140-8a7f1b5524e2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:58.114049 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-dfc1279d-62d0-4041-b140-8a7f1b5524e2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:58.122418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-dfc1279d-62d0-4041-b140-8a7f1b5524e2 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1274 microversion: 2.1 time: 0.099742 Jul 21 06:30:58.123058 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 41/81] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:58 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:58.316550 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-825bdcf6-2df4-4ae3-8669-d19a2cb152f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:58.318579 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-825bdcf6-2df4-4ae3-8669-d19a2cb152f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:58.334711 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-825bdcf6-2df4-4ae3-8669-d19a2cb152f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:58.335082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-825bdcf6-2df4-4ae3-8669-d19a2cb152f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:58.336708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-825bdcf6-2df4-4ae3-8669-d19a2cb152f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:58.337167 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-825bdcf6-2df4-4ae3-8669-d19a2cb152f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:58.459697 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6e0b4846-0fe0-411d-b93c-7a56b94d8f46 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:58.460509 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6e0b4846-0fe0-411d-b93c-7a56b94d8f46 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:58.472388 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6e0b4846-0fe0-411d-b93c-7a56b94d8f46 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:58.482714 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6e0b4846-0fe0-411d-b93c-7a56b94d8f46 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:58.483706 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6e0b4846-0fe0-411d-b93c-7a56b94d8f46 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:58.484237 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6e0b4846-0fe0-411d-b93c-7a56b94d8f46 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:58.511708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-825bdcf6-2df4-4ae3-8669-d19a2cb152f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:58.519461 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-825bdcf6-2df4-4ae3-8669-d19a2cb152f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1234 microversion: 2.1 time: 0.207857 Jul 21 06:30:58.525205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 41/82] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:58 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1234 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:30:58.583738 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3aa8eab9-b926-4c63-bafb-a7c190054e1c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:58.584368 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3aa8eab9-b926-4c63-bafb-a7c190054e1c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:58.593206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3aa8eab9-b926-4c63-bafb-a7c190054e1c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:58.598731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3aa8eab9-b926-4c63-bafb-a7c190054e1c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:58.600781 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3aa8eab9-b926-4c63-bafb-a7c190054e1c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:58.603188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3aa8eab9-b926-4c63-bafb-a7c190054e1c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:58.624858 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6e0b4846-0fe0-411d-b93c-7a56b94d8f46 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:58.636958 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6e0b4846-0fe0-411d-b93c-7a56b94d8f46 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:58.638848 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6e0b4846-0fe0-411d-b93c-7a56b94d8f46 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:58.641344 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6e0b4846-0fe0-411d-b93c-7a56b94d8f46 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1278 microversion: 2.20 time: 0.185484 Jul 21 06:30:58.642656 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 42/83] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:30:58 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:30:58.912818 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c76dae95-4276-425e-a077-efd64c301915 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:58.913824 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c76dae95-4276-425e-a077-efd64c301915 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:58.920801 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:58.923069 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c76dae95-4276-425e-a077-efd64c301915 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:58.924488 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c76dae95-4276-425e-a077-efd64c301915 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:58.926281 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c76dae95-4276-425e-a077-efd64c301915 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:58.926727 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c76dae95-4276-425e-a077-efd64c301915 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:59.053976 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c76dae95-4276-425e-a077-efd64c301915 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:59.061883 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c76dae95-4276-425e-a077-efd64c301915 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1301 microversion: 2.1 time: 0.154299 Jul 21 06:30:59.066282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 43/84] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:58 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1301 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:59.105393 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3aa8eab9-b926-4c63-bafb-a7c190054e1c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:59.124321 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3aa8eab9-b926-4c63-bafb-a7c190054e1c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.544305 Jul 21 06:30:59.140696 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1720349c-4aab-4761-89c6-f1130d6dc911 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:59.141168 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1720349c-4aab-4761-89c6-f1130d6dc911 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:59.150703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 42/85] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:58 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:59.153269 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1720349c-4aab-4761-89c6-f1130d6dc911 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:59.153735 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1720349c-4aab-4761-89c6-f1130d6dc911 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:59.154554 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1720349c-4aab-4761-89c6-f1130d6dc911 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:59.154995 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1720349c-4aab-4761-89c6-f1130d6dc911 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:59.196589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:59.269077 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=8 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:30:59.541794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f2c22a94-64ee-4c18-a0f2-672a3bb4d5bb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:59.543040 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f2c22a94-64ee-4c18-a0f2-672a3bb4d5bb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:59.555786 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f2c22a94-64ee-4c18-a0f2-672a3bb4d5bb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:59.556455 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f2c22a94-64ee-4c18-a0f2-672a3bb4d5bb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:59.557533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f2c22a94-64ee-4c18-a0f2-672a3bb4d5bb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:59.558101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f2c22a94-64ee-4c18-a0f2-672a3bb4d5bb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:59.750658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f2c22a94-64ee-4c18-a0f2-672a3bb4d5bb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:59.763026 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f2c22a94-64ee-4c18-a0f2-672a3bb4d5bb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1308 microversion: 2.1 time: 0.224999 Jul 21 06:30:59.763860 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 43/86] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:59 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:59.777740 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4b4eac99-fead-4567-91ec-7ba33b643282 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:30:59.778634 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4b4eac99-fead-4567-91ec-7ba33b643282 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:30:59.793826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4b4eac99-fead-4567-91ec-7ba33b643282 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:59.794414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4b4eac99-fead-4567-91ec-7ba33b643282 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:59.795280 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4b4eac99-fead-4567-91ec-7ba33b643282 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:30:59.795802 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4b4eac99-fead-4567-91ec-7ba33b643282 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:30:59.885028 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1720349c-4aab-4761-89c6-f1130d6dc911 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:30:59.896061 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1720349c-4aab-4761-89c6-f1130d6dc911 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.759409 Jul 21 06:30:59.898083 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 44/87] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:30:59 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:30:59.996069 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-4b4eac99-fead-4567-91ec-7ba33b643282 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:00.012447 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-4b4eac99-fead-4567-91ec-7ba33b643282 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:00.014441 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-4b4eac99-fead-4567-91ec-7ba33b643282 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:00.016641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4b4eac99-fead-4567-91ec-7ba33b643282 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1352 microversion: 2.20 time: 0.251057 Jul 21 06:31:00.017474 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 44/88] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:30:59 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1352 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:00.080346 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c3c2987a-2c7c-4bd3-8e1b-7b9b1d1cdf04 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:00.081679 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c3c2987a-2c7c-4bd3-8e1b-7b9b1d1cdf04 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:00.089442 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c3c2987a-2c7c-4bd3-8e1b-7b9b1d1cdf04 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:00.089899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c3c2987a-2c7c-4bd3-8e1b-7b9b1d1cdf04 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:00.090707 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c3c2987a-2c7c-4bd3-8e1b-7b9b1d1cdf04 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:00.091177 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c3c2987a-2c7c-4bd3-8e1b-7b9b1d1cdf04 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:00.144633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a12617bf-ec00-4a7a-b6ad-306a464b4cad tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:00.145486 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a12617bf-ec00-4a7a-b6ad-306a464b4cad tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:00.153332 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a12617bf-ec00-4a7a-b6ad-306a464b4cad tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:00.153783 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a12617bf-ec00-4a7a-b6ad-306a464b4cad tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:00.154606 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a12617bf-ec00-4a7a-b6ad-306a464b4cad tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:00.155045 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a12617bf-ec00-4a7a-b6ad-306a464b4cad tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:00.185082 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c3c2987a-2c7c-4bd3-8e1b-7b9b1d1cdf04 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:00.192643 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c3c2987a-2c7c-4bd3-8e1b-7b9b1d1cdf04 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1299 microversion: 2.1 time: 0.116109 Jul 21 06:31:00.193833 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 45/89] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:00 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:00.780576 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f71d9958-efc9-451d-9455-fca61b2c7432 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:00.781835 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f71d9958-efc9-451d-9455-fca61b2c7432 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:00.791176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f71d9958-efc9-451d-9455-fca61b2c7432 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:00.794285 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f71d9958-efc9-451d-9455-fca61b2c7432 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:00.799172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f71d9958-efc9-451d-9455-fca61b2c7432 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:00.799939 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f71d9958-efc9-451d-9455-fca61b2c7432 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:00.932060 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f71d9958-efc9-451d-9455-fca61b2c7432 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:00.937275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f71d9958-efc9-451d-9455-fca61b2c7432 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1296 microversion: 2.1 time: 0.160404 Jul 21 06:31:00.951187 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 46/90] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:00 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1296 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:00.958069 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-238af3bd-04b5-4bf9-b4a1-115421b003ca tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:00.961899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-238af3bd-04b5-4bf9-b4a1-115421b003ca tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:00.979902 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a12617bf-ec00-4a7a-b6ad-306a464b4cad tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:00.986963 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-238af3bd-04b5-4bf9-b4a1-115421b003ca tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:00.988567 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-238af3bd-04b5-4bf9-b4a1-115421b003ca tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:00.990806 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a12617bf-ec00-4a7a-b6ad-306a464b4cad tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.853526 Jul 21 06:31:00.991002 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-238af3bd-04b5-4bf9-b4a1-115421b003ca tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:00.992983 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-238af3bd-04b5-4bf9-b4a1-115421b003ca tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:00.996372 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 45/91] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:00 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:01.168437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-74e6c5ea-3130-42ea-bd18-43e20bc741fa req-8406db65-a384-4e9c-b9f7-8728b87de06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "294d6ad3-39c8-4bd2-85f6-3ba438468dd4", "tag": "d86e2ff8-1a3b-4b59-926e-c459aef0506d"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:01.202622 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-74e6c5ea-3130-42ea-bd18-43e20bc741fa req-8406db65-a384-4e9c-b9f7-8728b87de06d service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:01.203354 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-74e6c5ea-3130-42ea-bd18-43e20bc741fa req-8406db65-a384-4e9c-b9f7-8728b87de06d service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:01.235787 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-74e6c5ea-3130-42ea-bd18-43e20bc741fa req-8406db65-a384-4e9c-b9f7-8728b87de06d service nova] Creating event network-changed:d86e2ff8-1a3b-4b59-926e-c459aef0506d for instance 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 on hv-cinder-85031 Jul 21 06:31:01.236899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-74e6c5ea-3130-42ea-bd18-43e20bc741fa req-8406db65-a384-4e9c-b9f7-8728b87de06d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117906) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 06:31:01.238924 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f049009e-9594-469b-b993-84657ecf0fe7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:01.240927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f049009e-9594-469b-b993-84657ecf0fe7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:01.247448 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f049009e-9594-469b-b993-84657ecf0fe7 None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:01.248769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f049009e-9594-469b-b993-84657ecf0fe7 None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:01.269711 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.compute.rpcapi [None req-f049009e-9594-469b-b993-84657ecf0fe7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 06:31:01.270880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f049009e-9594-469b-b993-84657ecf0fe7 None None] Releasing lock "compute-rpcapi-router" {{(pid=117906) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 06:31:01.307215 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f049009e-9594-469b-b993-84657ecf0fe7 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309019 Jul 21 06:31:01.309392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 46/92] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:01.317843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b8609033-b351-4ff1-aec5-31895c9fe39f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:01.318700 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b8609033-b351-4ff1-aec5-31895c9fe39f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:01.346335 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b8609033-b351-4ff1-aec5-31895c9fe39f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:01.346860 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b8609033-b351-4ff1-aec5-31895c9fe39f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:01.347828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b8609033-b351-4ff1-aec5-31895c9fe39f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:01.348276 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b8609033-b351-4ff1-aec5-31895c9fe39f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:01.353657 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:01.603800 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b8609033-b351-4ff1-aec5-31895c9fe39f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:01.626656 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b8609033-b351-4ff1-aec5-31895c9fe39f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:01.629668 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b8609033-b351-4ff1-aec5-31895c9fe39f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:01.631424 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b8609033-b351-4ff1-aec5-31895c9fe39f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1340 microversion: 2.20 time: 0.319597 Jul 21 06:31:01.631548 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-238af3bd-04b5-4bf9-b4a1-115421b003ca tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:01.633965 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 47/93] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:01 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1340 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:01.640144 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-455aa142-af20-4337-b897-5e86d9cfb1bd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:01.641105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-455aa142-af20-4337-b897-5e86d9cfb1bd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:01.650463 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-455aa142-af20-4337-b897-5e86d9cfb1bd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:01.651386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-455aa142-af20-4337-b897-5e86d9cfb1bd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:01.652643 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-455aa142-af20-4337-b897-5e86d9cfb1bd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:01.653431 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-455aa142-af20-4337-b897-5e86d9cfb1bd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:01.670920 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-238af3bd-04b5-4bf9-b4a1-115421b003ca tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.711584 Jul 21 06:31:01.676031 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 47/94] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:00 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:01.779239 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-455aa142-af20-4337-b897-5e86d9cfb1bd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:01.788401 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-455aa142-af20-4337-b897-5e86d9cfb1bd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1299 microversion: 2.1 time: 0.152505 Jul 21 06:31:01.793065 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 48/95] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:01 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:01.962343 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6f5893b8-1eb0-44db-9d15-0403e8f77b1f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:01.963209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6f5893b8-1eb0-44db-9d15-0403e8f77b1f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:01.975126 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6f5893b8-1eb0-44db-9d15-0403e8f77b1f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:01.976946 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6f5893b8-1eb0-44db-9d15-0403e8f77b1f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:01.980884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6f5893b8-1eb0-44db-9d15-0403e8f77b1f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:01.983099 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6f5893b8-1eb0-44db-9d15-0403e8f77b1f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:02.017555 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5d3a214c-ab17-4c5e-b1ee-1a4e9f1436f9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:02.019386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5d3a214c-ab17-4c5e-b1ee-1a4e9f1436f9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:02.032851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5d3a214c-ab17-4c5e-b1ee-1a4e9f1436f9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:02.033657 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5d3a214c-ab17-4c5e-b1ee-1a4e9f1436f9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:02.036231 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5d3a214c-ab17-4c5e-b1ee-1a4e9f1436f9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:02.037204 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5d3a214c-ab17-4c5e-b1ee-1a4e9f1436f9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:02.127316 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6f5893b8-1eb0-44db-9d15-0403e8f77b1f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:02.148782 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6f5893b8-1eb0-44db-9d15-0403e8f77b1f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1296 microversion: 2.1 time: 0.185372 Jul 21 06:31:02.152550 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 48/96] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:01 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1296 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:02.415608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5d3a214c-ab17-4c5e-b1ee-1a4e9f1436f9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:02.423381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5d3a214c-ab17-4c5e-b1ee-1a4e9f1436f9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.412383 Jul 21 06:31:02.424256 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 49/97] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:02 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:02.652058 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d235cfec-9081-4034-9d7b-8258d712038f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:02.652777 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d235cfec-9081-4034-9d7b-8258d712038f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:02.659234 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d235cfec-9081-4034-9d7b-8258d712038f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:02.659775 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d235cfec-9081-4034-9d7b-8258d712038f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:02.660624 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d235cfec-9081-4034-9d7b-8258d712038f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:02.661067 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d235cfec-9081-4034-9d7b-8258d712038f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:02.694358 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c7389a19-7970-41d2-b675-6cf78d04cdd8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:02.695896 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c7389a19-7970-41d2-b675-6cf78d04cdd8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:02.718074 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c7389a19-7970-41d2-b675-6cf78d04cdd8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:02.718527 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c7389a19-7970-41d2-b675-6cf78d04cdd8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:02.719366 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c7389a19-7970-41d2-b675-6cf78d04cdd8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:02.719796 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c7389a19-7970-41d2-b675-6cf78d04cdd8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:02.740420 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d235cfec-9081-4034-9d7b-8258d712038f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:02.749927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d235cfec-9081-4034-9d7b-8258d712038f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:02.751745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d235cfec-9081-4034-9d7b-8258d712038f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:02.753041 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d235cfec-9081-4034-9d7b-8258d712038f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1340 microversion: 2.20 time: 0.105867 Jul 21 06:31:02.754137 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 49/98] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:02 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1340 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:02.809988 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-bf0775b8-dc1e-4a32-9486-1007084112d4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:02.810932 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-bf0775b8-dc1e-4a32-9486-1007084112d4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:02.823574 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bf0775b8-dc1e-4a32-9486-1007084112d4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:02.824181 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bf0775b8-dc1e-4a32-9486-1007084112d4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:02.824783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bf0775b8-dc1e-4a32-9486-1007084112d4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:02.825221 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bf0775b8-dc1e-4a32-9486-1007084112d4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:02.908499 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bf0775b8-dc1e-4a32-9486-1007084112d4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:02.910684 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c7389a19-7970-41d2-b675-6cf78d04cdd8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:02.917788 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-bf0775b8-dc1e-4a32-9486-1007084112d4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1299 microversion: 2.1 time: 0.113176 Jul 21 06:31:02.918494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 50/99] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:02 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:02.920661 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c7389a19-7970-41d2-b675-6cf78d04cdd8 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.235770 Jul 21 06:31:02.923080 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 50/100] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:02 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:02.999918 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-0c674a73-934b-49ca-b32f-c722465c93a0 req-0bf68c53-4b1b-45f9-bf18-359615f23ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7", "tag": "5b1a0fbc-da41-4a91-9ccb-b82810ccd7ef"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:03.011382 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-0c674a73-934b-49ca-b32f-c722465c93a0 req-0bf68c53-4b1b-45f9-bf18-359615f23ce5 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:03.011822 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-0c674a73-934b-49ca-b32f-c722465c93a0 req-0bf68c53-4b1b-45f9-bf18-359615f23ce5 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:03.033219 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-0c674a73-934b-49ca-b32f-c722465c93a0 req-0bf68c53-4b1b-45f9-bf18-359615f23ce5 service nova] Creating event network-changed:5b1a0fbc-da41-4a91-9ccb-b82810ccd7ef for instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 on hv-cinder-85031 Jul 21 06:31:03.034028 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-0c674a73-934b-49ca-b32f-c722465c93a0 req-0bf68c53-4b1b-45f9-bf18-359615f23ce5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117905) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 06:31:03.035350 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96ad6ee9-9f94-48dd-8e1c-1e62bb31f65f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:03.035985 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96ad6ee9-9f94-48dd-8e1c-1e62bb31f65f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:03.036969 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96ad6ee9-9f94-48dd-8e1c-1e62bb31f65f None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:03.037590 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96ad6ee9-9f94-48dd-8e1c-1e62bb31f65f None None] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:03.071276 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.compute.rpcapi [None req-96ad6ee9-9f94-48dd-8e1c-1e62bb31f65f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 06:31:03.072544 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96ad6ee9-9f94-48dd-8e1c-1e62bb31f65f None None] Releasing lock "compute-rpcapi-router" {{(pid=117905) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 06:31:03.097524 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-96ad6ee9-9f94-48dd-8e1c-1e62bb31f65f None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177584 Jul 21 06:31:03.098195 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 51/101] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:03.173699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-47a03a12-b577-42d3-ac04-3512b336ab4d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:03.174712 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-47a03a12-b577-42d3-ac04-3512b336ab4d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:03.227441 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-47a03a12-b577-42d3-ac04-3512b336ab4d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:03.229654 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-47a03a12-b577-42d3-ac04-3512b336ab4d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:03.233309 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-47a03a12-b577-42d3-ac04-3512b336ab4d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:03.254778 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-47a03a12-b577-42d3-ac04-3512b336ab4d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:03.396048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-8dfa9296-90d3-41d0-8a3e-a03e053b902a req-59c0eafb-05de-4e15-8023-7183cf332d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746e5366-e38d-4694-b0dc-5d71af0c69d3", "tag": "066e9645-9422-4d88-a511-31ab25daf6de"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:03.408457 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-8dfa9296-90d3-41d0-8a3e-a03e053b902a req-59c0eafb-05de-4e15-8023-7183cf332d5b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:03.409550 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-8dfa9296-90d3-41d0-8a3e-a03e053b902a req-59c0eafb-05de-4e15-8023-7183cf332d5b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:03.440198 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-8dfa9296-90d3-41d0-8a3e-a03e053b902a req-59c0eafb-05de-4e15-8023-7183cf332d5b service nova] Creating event network-changed:066e9645-9422-4d88-a511-31ab25daf6de for instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 on hv-cinder-85031 Jul 21 06:31:03.454299 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-8dfa9296-90d3-41d0-8a3e-a03e053b902a req-59c0eafb-05de-4e15-8023-7183cf332d5b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067256 Jul 21 06:31:03.456655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 52/102] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:31:03.466597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6bdf68d8-ae6b-4c0c-bcf8-75ab7bb54f5d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:03.470710 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6bdf68d8-ae6b-4c0c-bcf8-75ab7bb54f5d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:03.495353 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6bdf68d8-ae6b-4c0c-bcf8-75ab7bb54f5d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:03.495819 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6bdf68d8-ae6b-4c0c-bcf8-75ab7bb54f5d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:03.496628 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6bdf68d8-ae6b-4c0c-bcf8-75ab7bb54f5d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:03.497133 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6bdf68d8-ae6b-4c0c-bcf8-75ab7bb54f5d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:04.068004 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-47a03a12-b577-42d3-ac04-3512b336ab4d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:04.078410 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-47a03a12-b577-42d3-ac04-3512b336ab4d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.915596 Jul 21 06:31:04.090212 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 51/103] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:03 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:04.095229 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-643674f1-2185-4cb0-be32-403b7989060f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:04.096078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-643674f1-2185-4cb0-be32-403b7989060f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:04.104106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-643674f1-2185-4cb0-be32-403b7989060f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:04.104841 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-643674f1-2185-4cb0-be32-403b7989060f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:04.105813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-643674f1-2185-4cb0-be32-403b7989060f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:04.106595 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-643674f1-2185-4cb0-be32-403b7989060f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:04.125900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6bdf68d8-ae6b-4c0c-bcf8-75ab7bb54f5d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:04.135847 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6bdf68d8-ae6b-4c0c-bcf8-75ab7bb54f5d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.676805 Jul 21 06:31:04.152726 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 53/104] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:03 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:04.157496 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-13357331-bbaf-4a96-98b0-c0cdb2c25d23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:04.158278 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-13357331-bbaf-4a96-98b0-c0cdb2c25d23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:04.165924 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13357331-bbaf-4a96-98b0-c0cdb2c25d23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:04.166431 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13357331-bbaf-4a96-98b0-c0cdb2c25d23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:04.167339 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13357331-bbaf-4a96-98b0-c0cdb2c25d23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:04.168507 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13357331-bbaf-4a96-98b0-c0cdb2c25d23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:04.483813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-13357331-bbaf-4a96-98b0-c0cdb2c25d23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:04.502915 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-13357331-bbaf-4a96-98b0-c0cdb2c25d23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.348996 Jul 21 06:31:04.516986 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 54/105] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:04 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:04.530071 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-643674f1-2185-4cb0-be32-403b7989060f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:04.546317 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4fe83f76-7356-4c3b-a4d5-c86fbdba0f2f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:04.547556 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-643674f1-2185-4cb0-be32-403b7989060f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:04.551019 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-643674f1-2185-4cb0-be32-403b7989060f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:04.553217 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4fe83f76-7356-4c3b-a4d5-c86fbdba0f2f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:04.558273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-643674f1-2185-4cb0-be32-403b7989060f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.466707 Jul 21 06:31:04.574605 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 52/106] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:04 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:04.579450 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4fe83f76-7356-4c3b-a4d5-c86fbdba0f2f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:04.580228 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4fe83f76-7356-4c3b-a4d5-c86fbdba0f2f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:04.581853 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4fe83f76-7356-4c3b-a4d5-c86fbdba0f2f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:04.582472 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4fe83f76-7356-4c3b-a4d5-c86fbdba0f2f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:04.862144 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4fe83f76-7356-4c3b-a4d5-c86fbdba0f2f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:04.894754 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4fe83f76-7356-4c3b-a4d5-c86fbdba0f2f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.373960 Jul 21 06:31:04.896345 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 55/107] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:04 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:05.096582 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-86289a62-8bc8-4ed9-ac1d-ec00897dc942 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:05.097331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-86289a62-8bc8-4ed9-ac1d-ec00897dc942 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:05.108414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-86289a62-8bc8-4ed9-ac1d-ec00897dc942 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:05.112389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-86289a62-8bc8-4ed9-ac1d-ec00897dc942 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:05.117122 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-86289a62-8bc8-4ed9-ac1d-ec00897dc942 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:05.118412 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-86289a62-8bc8-4ed9-ac1d-ec00897dc942 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:05.154597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-354ad39b-a097-4331-843d-9fb300bcf51b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:05.155382 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-354ad39b-a097-4331-843d-9fb300bcf51b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:05.171250 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-354ad39b-a097-4331-843d-9fb300bcf51b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:05.175441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-354ad39b-a097-4331-843d-9fb300bcf51b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:05.176535 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-354ad39b-a097-4331-843d-9fb300bcf51b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:05.177759 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-354ad39b-a097-4331-843d-9fb300bcf51b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:05.716218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-86289a62-8bc8-4ed9-ac1d-ec00897dc942 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:05.722082 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-354ad39b-a097-4331-843d-9fb300bcf51b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:05.727085 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-86289a62-8bc8-4ed9-ac1d-ec00897dc942 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.633307 Jul 21 06:31:05.737180 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 53/108] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:05 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:05.743219 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3e79255f-e684-4a53-93ab-da2c5f987a43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:05.744264 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3e79255f-e684-4a53-93ab-da2c5f987a43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:05.752169 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3e79255f-e684-4a53-93ab-da2c5f987a43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:05.753485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3e79255f-e684-4a53-93ab-da2c5f987a43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:05.754564 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3e79255f-e684-4a53-93ab-da2c5f987a43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:05.755455 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3e79255f-e684-4a53-93ab-da2c5f987a43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:05.765275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-354ad39b-a097-4331-843d-9fb300bcf51b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.615836 Jul 21 06:31:05.766644 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 56/109] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:05 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:05.813334 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e66ee30c-1044-420e-bbdd-f6b718637f85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:05.814953 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e66ee30c-1044-420e-bbdd-f6b718637f85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:05.856504 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e66ee30c-1044-420e-bbdd-f6b718637f85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:05.857181 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e66ee30c-1044-420e-bbdd-f6b718637f85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:05.858030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e66ee30c-1044-420e-bbdd-f6b718637f85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:05.858495 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e66ee30c-1044-420e-bbdd-f6b718637f85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:06.370907 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3e79255f-e684-4a53-93ab-da2c5f987a43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:06.381299 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3e79255f-e684-4a53-93ab-da2c5f987a43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.642293 Jul 21 06:31:06.383731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 54/110] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:05 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:06.440129 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6063817f-6f04-4856-806c-300a9143e5b0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:06.441920 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6063817f-6f04-4856-806c-300a9143e5b0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:06.491650 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6063817f-6f04-4856-806c-300a9143e5b0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:06.493735 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6063817f-6f04-4856-806c-300a9143e5b0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:06.497250 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6063817f-6f04-4856-806c-300a9143e5b0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:06.511921 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6063817f-6f04-4856-806c-300a9143e5b0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:06.926232 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e66ee30c-1044-420e-bbdd-f6b718637f85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:06.945231 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e66ee30c-1044-420e-bbdd-f6b718637f85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:06.952999 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e66ee30c-1044-420e-bbdd-f6b718637f85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:06.959732 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e66ee30c-1044-420e-bbdd-f6b718637f85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 1.162300 Jul 21 06:31:06.972008 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 57/111] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:05 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:06.986909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-57f080e1-08db-4904-bfdb-e76004a181b1 req-73eea304-c321-4773-98b6-30a5f3087dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f81355-5e49-4559-b29c-b6faefe880b7", "tag": "0004c418-8336-40b0-9995-58b47e33de84"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:07.013764 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-57f080e1-08db-4904-bfdb-e76004a181b1 req-73eea304-c321-4773-98b6-30a5f3087dce service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:07.014413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-57f080e1-08db-4904-bfdb-e76004a181b1 req-73eea304-c321-4773-98b6-30a5f3087dce service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:07.048828 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-57f080e1-08db-4904-bfdb-e76004a181b1 req-73eea304-c321-4773-98b6-30a5f3087dce service nova] Creating event network-changed:0004c418-8336-40b0-9995-58b47e33de84 for instance 43f81355-5e49-4559-b29c-b6faefe880b7 on hv-cinder-85031 Jul 21 06:31:07.055597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-57f080e1-08db-4904-bfdb-e76004a181b1 req-73eea304-c321-4773-98b6-30a5f3087dce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080834 Jul 21 06:31:07.057105 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 58/112] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:07.063447 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fa9ada50-405d-4a3e-a74c-4882dd8efc34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:07.064424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fa9ada50-405d-4a3e-a74c-4882dd8efc34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:07.073103 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fa9ada50-405d-4a3e-a74c-4882dd8efc34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:07.074167 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fa9ada50-405d-4a3e-a74c-4882dd8efc34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:07.076113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fa9ada50-405d-4a3e-a74c-4882dd8efc34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:07.077189 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fa9ada50-405d-4a3e-a74c-4882dd8efc34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:07.312237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6063817f-6f04-4856-806c-300a9143e5b0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:07.334925 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6063817f-6f04-4856-806c-300a9143e5b0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.949447 Jul 21 06:31:07.354591 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 55/113] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:06 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:07.359858 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8ea4c6d7-d8d8-4135-b6af-45d40b402811 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:07.360722 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8ea4c6d7-d8d8-4135-b6af-45d40b402811 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:07.367933 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8ea4c6d7-d8d8-4135-b6af-45d40b402811 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:07.368588 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8ea4c6d7-d8d8-4135-b6af-45d40b402811 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:07.369551 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8ea4c6d7-d8d8-4135-b6af-45d40b402811 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:07.370219 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8ea4c6d7-d8d8-4135-b6af-45d40b402811 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:07.700327 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fa9ada50-405d-4a3e-a74c-4882dd8efc34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:07.708614 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fa9ada50-405d-4a3e-a74c-4882dd8efc34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.649997 Jul 21 06:31:07.710385 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 59/114] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:07 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:07.913712 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8ea4c6d7-d8d8-4135-b6af-45d40b402811 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:07.926162 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8ea4c6d7-d8d8-4135-b6af-45d40b402811 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.570210 Jul 21 06:31:07.928364 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 56/115] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:07 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:07.928824 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-82af0c81-308e-4b1c-b245-5582de461749 req-aae22e7d-72da-456c-a597-cc71a64393ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294d6ad3-39c8-4bd2-85f6-3ba438468dd4", "name": "network-vif-plugged", "status": "completed", "tag": "d86e2ff8-1a3b-4b59-926e-c459aef0506d"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:07.934593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8312d199-ab39-44a5-abd7-30cbfbdf4065 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:07.935214 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8312d199-ab39-44a5-abd7-30cbfbdf4065 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:07.938396 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-82af0c81-308e-4b1c-b245-5582de461749 req-aae22e7d-72da-456c-a597-cc71a64393ac service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:07.939068 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-82af0c81-308e-4b1c-b245-5582de461749 req-aae22e7d-72da-456c-a597-cc71a64393ac service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:07.945801 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8312d199-ab39-44a5-abd7-30cbfbdf4065 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:07.946377 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8312d199-ab39-44a5-abd7-30cbfbdf4065 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:07.948036 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8312d199-ab39-44a5-abd7-30cbfbdf4065 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:07.949132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8312d199-ab39-44a5-abd7-30cbfbdf4065 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:07.957662 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-82af0c81-308e-4b1c-b245-5582de461749 req-aae22e7d-72da-456c-a597-cc71a64393ac service nova] Creating event network-vif-plugged:d86e2ff8-1a3b-4b59-926e-c459aef0506d for instance 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 on hv-cinder-85031 Jul 21 06:31:07.979410 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-82af0c81-308e-4b1c-b245-5582de461749 req-aae22e7d-72da-456c-a597-cc71a64393ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267458 Jul 21 06:31:07.980877 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 60/116] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:07.998500 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ea984a5f-4ec8-48b5-a33f-3a21964ea98d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:08.000181 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ea984a5f-4ec8-48b5-a33f-3a21964ea98d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:08.008286 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ea984a5f-4ec8-48b5-a33f-3a21964ea98d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:08.008927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ea984a5f-4ec8-48b5-a33f-3a21964ea98d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:08.009705 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ea984a5f-4ec8-48b5-a33f-3a21964ea98d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:08.010165 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ea984a5f-4ec8-48b5-a33f-3a21964ea98d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:08.343175 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8312d199-ab39-44a5-abd7-30cbfbdf4065 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:08.354197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8312d199-ab39-44a5-abd7-30cbfbdf4065 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.423995 Jul 21 06:31:08.360160 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 57/117] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:07 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:08.368204 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e73fde20-f666-405c-b2ff-02faf8917d6f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:08.369137 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e73fde20-f666-405c-b2ff-02faf8917d6f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:08.376568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e73fde20-f666-405c-b2ff-02faf8917d6f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:08.377424 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e73fde20-f666-405c-b2ff-02faf8917d6f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:08.381931 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ea984a5f-4ec8-48b5-a33f-3a21964ea98d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:08.399420 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e73fde20-f666-405c-b2ff-02faf8917d6f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:08.402596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e73fde20-f666-405c-b2ff-02faf8917d6f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:08.407653 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ea984a5f-4ec8-48b5-a33f-3a21964ea98d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:08.412058 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ea984a5f-4ec8-48b5-a33f-3a21964ea98d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:08.417524 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ea984a5f-4ec8-48b5-a33f-3a21964ea98d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.430340 Jul 21 06:31:08.447897 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 61/118] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:07 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:08.693826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e73fde20-f666-405c-b2ff-02faf8917d6f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:08.703018 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e73fde20-f666-405c-b2ff-02faf8917d6f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.340924 Jul 21 06:31:08.703619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 58/119] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:08 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:08.728117 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a73bdd52-f7fe-4d2c-a47d-eca911d61d4a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:08.728734 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a73bdd52-f7fe-4d2c-a47d-eca911d61d4a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:08.739041 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a73bdd52-f7fe-4d2c-a47d-eca911d61d4a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:08.739492 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a73bdd52-f7fe-4d2c-a47d-eca911d61d4a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:08.740313 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a73bdd52-f7fe-4d2c-a47d-eca911d61d4a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:08.740739 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a73bdd52-f7fe-4d2c-a47d-eca911d61d4a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:08.945589 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-73e37f8d-1be2-4204-8c20-ca6e9f6e68c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:08.946412 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-73e37f8d-1be2-4204-8c20-ca6e9f6e68c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:08.955009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:08.957442 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73e37f8d-1be2-4204-8c20-ca6e9f6e68c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:08.958277 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73e37f8d-1be2-4204-8c20-ca6e9f6e68c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:08.959604 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73e37f8d-1be2-4204-8c20-ca6e9f6e68c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:08.961136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73e37f8d-1be2-4204-8c20-ca6e9f6e68c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:08.969038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a73bdd52-f7fe-4d2c-a47d-eca911d61d4a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:08.986607 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a73bdd52-f7fe-4d2c-a47d-eca911d61d4a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.261361 Jul 21 06:31:08.988036 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 62/120] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:08 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:09.168661 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-73e37f8d-1be2-4204-8c20-ca6e9f6e68c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:09.179452 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-73e37f8d-1be2-4204-8c20-ca6e9f6e68c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.238412 Jul 21 06:31:09.187861 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-72d2f277-868f-4f88-87a7-6db54f0787c6 req-63692fc7-df57-4b82-942b-ae589575a001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7788e87-32b8-4250-bae6-b666d958ab97", "tag": "64c03855-c1db-478e-916b-e86e4f9e9bdc"}, {"name": "network-changed", "server_uuid": "a40d32b1-a161-49f9-a2ae-fe794e9a66cd", "tag": "345fc32c-f55c-4636-be16-4b276cd0c105"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:09.193589 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 59/121] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:08 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:09.203973 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-72d2f277-868f-4f88-87a7-6db54f0787c6 req-63692fc7-df57-4b82-942b-ae589575a001 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:09.204912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-72d2f277-868f-4f88-87a7-6db54f0787c6 req-63692fc7-df57-4b82-942b-ae589575a001 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:09.222774 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-72d2f277-868f-4f88-87a7-6db54f0787c6 req-63692fc7-df57-4b82-942b-ae589575a001 service nova] Creating event network-changed:64c03855-c1db-478e-916b-e86e4f9e9bdc for instance e7788e87-32b8-4250-bae6-b666d958ab97 on hv-cinder-85031 Jul 21 06:31:09.224431 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-72d2f277-868f-4f88-87a7-6db54f0787c6 req-63692fc7-df57-4b82-942b-ae589575a001 service nova] Creating event network-changed:345fc32c-f55c-4636-be16-4b276cd0c105 for instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd on hv-cinder-85031 Jul 21 06:31:09.235558 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-72d2f277-868f-4f88-87a7-6db54f0787c6 req-63692fc7-df57-4b82-942b-ae589575a001 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051472 Jul 21 06:31:09.236227 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 63/122] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:09.373569 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-167d74be-ed35-4a60-a1b6-4c0346a8369d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:09.374307 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-167d74be-ed35-4a60-a1b6-4c0346a8369d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:09.381055 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-167d74be-ed35-4a60-a1b6-4c0346a8369d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:09.381568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-167d74be-ed35-4a60-a1b6-4c0346a8369d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:09.382464 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-167d74be-ed35-4a60-a1b6-4c0346a8369d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:09.383124 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-167d74be-ed35-4a60-a1b6-4c0346a8369d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:09.472084 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e8a1550a-2437-42d4-9a78-a68adebfb35e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:09.472803 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e8a1550a-2437-42d4-9a78-a68adebfb35e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:09.484797 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e8a1550a-2437-42d4-9a78-a68adebfb35e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:09.485248 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e8a1550a-2437-42d4-9a78-a68adebfb35e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:09.486642 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e8a1550a-2437-42d4-9a78-a68adebfb35e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:09.487092 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e8a1550a-2437-42d4-9a78-a68adebfb35e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:09.493857 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:09.544571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-167d74be-ed35-4a60-a1b6-4c0346a8369d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:09.559244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-167d74be-ed35-4a60-a1b6-4c0346a8369d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.186750 Jul 21 06:31:09.561115 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 60/123] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:09 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:09.669429 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e8a1550a-2437-42d4-9a78-a68adebfb35e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:09.677984 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e8a1550a-2437-42d4-9a78-a68adebfb35e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:09.680380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e8a1550a-2437-42d4-9a78-a68adebfb35e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:09.681796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e8a1550a-2437-42d4-9a78-a68adebfb35e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.218590 Jul 21 06:31:09.682598 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 64/124] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:09 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:09.723079 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5ce9c929-1756-47d7-b487-4333dff34f01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:09.724260 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5ce9c929-1756-47d7-b487-4333dff34f01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:09.732473 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5ce9c929-1756-47d7-b487-4333dff34f01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:09.733228 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5ce9c929-1756-47d7-b487-4333dff34f01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:09.734607 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5ce9c929-1756-47d7-b487-4333dff34f01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:09.735580 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5ce9c929-1756-47d7-b487-4333dff34f01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:09.911914 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5ce9c929-1756-47d7-b487-4333dff34f01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:09.924383 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5ce9c929-1756-47d7-b487-4333dff34f01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.205529 Jul 21 06:31:09.925188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 61/125] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:09 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:10.005181 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-519d5182-b6e3-41b1-ab2b-ba4de3bebeda req-f097f8a9-efc6-498e-91e2-025ee66a6ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746e5366-e38d-4694-b0dc-5d71af0c69d3", "name": "network-vif-plugged", "status": "completed", "tag": "066e9645-9422-4d88-a511-31ab25daf6de"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:10.011865 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-326f2b9a-0bf4-4ee3-9724-166df82a6e16 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:10.012888 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-326f2b9a-0bf4-4ee3-9724-166df82a6e16 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:10.016289 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-519d5182-b6e3-41b1-ab2b-ba4de3bebeda req-f097f8a9-efc6-498e-91e2-025ee66a6ed3 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.017061 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-519d5182-b6e3-41b1-ab2b-ba4de3bebeda req-f097f8a9-efc6-498e-91e2-025ee66a6ed3 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:10.027081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-326f2b9a-0bf4-4ee3-9724-166df82a6e16 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.028500 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-326f2b9a-0bf4-4ee3-9724-166df82a6e16 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:10.030011 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-326f2b9a-0bf4-4ee3-9724-166df82a6e16 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.031192 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-326f2b9a-0bf4-4ee3-9724-166df82a6e16 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:10.038660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-519d5182-b6e3-41b1-ab2b-ba4de3bebeda req-f097f8a9-efc6-498e-91e2-025ee66a6ed3 service nova] Creating event network-vif-plugged:066e9645-9422-4d88-a511-31ab25daf6de for instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 on hv-cinder-85031 Jul 21 06:31:10.044845 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-519d5182-b6e3-41b1-ab2b-ba4de3bebeda req-f097f8a9-efc6-498e-91e2-025ee66a6ed3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043538 Jul 21 06:31:10.046087 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 65/126] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:10.201142 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a792dd5a-9921-45d1-898f-398b7dbfd356 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:10.202293 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a792dd5a-9921-45d1-898f-398b7dbfd356 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:10.208412 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-326f2b9a-0bf4-4ee3-9724-166df82a6e16 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:10.217252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-326f2b9a-0bf4-4ee3-9724-166df82a6e16 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.211767 Jul 21 06:31:10.218869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 62/127] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:10 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:10.224736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a792dd5a-9921-45d1-898f-398b7dbfd356 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.226873 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a792dd5a-9921-45d1-898f-398b7dbfd356 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:10.227886 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a792dd5a-9921-45d1-898f-398b7dbfd356 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.228723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a792dd5a-9921-45d1-898f-398b7dbfd356 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:10.426166 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a792dd5a-9921-45d1-898f-398b7dbfd356 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:10.438295 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a792dd5a-9921-45d1-898f-398b7dbfd356 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.241326 Jul 21 06:31:10.442127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 66/128] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:10 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:10.578353 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3a630804-da52-4d70-8853-5c709b0da5b7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:10.579654 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3a630804-da52-4d70-8853-5c709b0da5b7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:10.588599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3a630804-da52-4d70-8853-5c709b0da5b7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.589616 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3a630804-da52-4d70-8853-5c709b0da5b7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:10.590668 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3a630804-da52-4d70-8853-5c709b0da5b7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.591314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3a630804-da52-4d70-8853-5c709b0da5b7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:10.705842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-39200876-4938-4aca-9dda-77d9696af876 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:10.706584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-39200876-4938-4aca-9dda-77d9696af876 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:10.718074 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-39200876-4938-4aca-9dda-77d9696af876 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.718765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-39200876-4938-4aca-9dda-77d9696af876 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:10.719715 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-39200876-4938-4aca-9dda-77d9696af876 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.720953 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-39200876-4938-4aca-9dda-77d9696af876 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:10.766621 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3a630804-da52-4d70-8853-5c709b0da5b7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:10.771818 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:10.779648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3a630804-da52-4d70-8853-5c709b0da5b7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.206077 Jul 21 06:31:10.791574 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 63/129] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:10 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:10.888676 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-39200876-4938-4aca-9dda-77d9696af876 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:10.899916 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-39200876-4938-4aca-9dda-77d9696af876 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:10.901710 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-39200876-4938-4aca-9dda-77d9696af876 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:10.903105 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-39200876-4938-4aca-9dda-77d9696af876 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.204954 Jul 21 06:31:10.903687 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 67/130] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:10 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:31:10.941863 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9fa77624-18c9-48e4-8991-e73541dc0f7f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:10.942641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9fa77624-18c9-48e4-8991-e73541dc0f7f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:10.953348 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9fa77624-18c9-48e4-8991-e73541dc0f7f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.953800 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9fa77624-18c9-48e4-8991-e73541dc0f7f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:10.954779 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9fa77624-18c9-48e4-8991-e73541dc0f7f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:10.955215 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9fa77624-18c9-48e4-8991-e73541dc0f7f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:11.142433 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9fa77624-18c9-48e4-8991-e73541dc0f7f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:11.152414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9fa77624-18c9-48e4-8991-e73541dc0f7f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.214696 Jul 21 06:31:11.153218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 64/131] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:10 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:11.235556 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-25dff5fe-a230-42f8-850b-be480c637b93 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:11.236825 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-25dff5fe-a230-42f8-850b-be480c637b93 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:11.245518 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-25dff5fe-a230-42f8-850b-be480c637b93 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:11.246181 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-25dff5fe-a230-42f8-850b-be480c637b93 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:11.246842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-25dff5fe-a230-42f8-850b-be480c637b93 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:11.247273 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-25dff5fe-a230-42f8-850b-be480c637b93 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:11.389309 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-25dff5fe-a230-42f8-850b-be480c637b93 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:11.398071 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-25dff5fe-a230-42f8-850b-be480c637b93 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.166380 Jul 21 06:31:11.398659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 68/132] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:11 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:11.455415 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1747efae-cb84-4ac9-bc10-0bcc89d16548 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:11.456032 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1747efae-cb84-4ac9-bc10-0bcc89d16548 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:11.457866 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:11.467130 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1747efae-cb84-4ac9-bc10-0bcc89d16548 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:11.467804 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1747efae-cb84-4ac9-bc10-0bcc89d16548 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:11.469018 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1747efae-cb84-4ac9-bc10-0bcc89d16548 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:11.469612 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1747efae-cb84-4ac9-bc10-0bcc89d16548 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:11.609658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1747efae-cb84-4ac9-bc10-0bcc89d16548 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:11.618160 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1747efae-cb84-4ac9-bc10-0bcc89d16548 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.166598 Jul 21 06:31:11.618746 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 65/133] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:11 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:11.796395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c58649f4-72b3-40c1-8841-22a5c934780d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:11.797001 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c58649f4-72b3-40c1-8841-22a5c934780d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:11.803494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c58649f4-72b3-40c1-8841-22a5c934780d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:11.805266 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c58649f4-72b3-40c1-8841-22a5c934780d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:11.806217 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c58649f4-72b3-40c1-8841-22a5c934780d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:11.806839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c58649f4-72b3-40c1-8841-22a5c934780d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:11.920545 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-737e7daa-8e16-4e94-b187-23c779abcd83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:11.921146 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-737e7daa-8e16-4e94-b187-23c779abcd83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:11.927026 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-737e7daa-8e16-4e94-b187-23c779abcd83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:11.927471 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-737e7daa-8e16-4e94-b187-23c779abcd83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:11.928229 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-737e7daa-8e16-4e94-b187-23c779abcd83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:11.928672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-737e7daa-8e16-4e94-b187-23c779abcd83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:11.943405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c58649f4-72b3-40c1-8841-22a5c934780d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:11.950821 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c58649f4-72b3-40c1-8841-22a5c934780d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.158158 Jul 21 06:31:11.951394 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 69/134] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:11 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:12.060334 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-f7cb913a-1221-4f41-8257-d9ef941772c6 req-b4f70b3e-cd09-4a73-9c59-679f89d22815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7", "name": "network-vif-plugged", "status": "completed", "tag": "5b1a0fbc-da41-4a91-9ccb-b82810ccd7ef"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:12.068883 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-f7cb913a-1221-4f41-8257-d9ef941772c6 req-b4f70b3e-cd09-4a73-9c59-679f89d22815 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:12.069385 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-f7cb913a-1221-4f41-8257-d9ef941772c6 req-b4f70b3e-cd09-4a73-9c59-679f89d22815 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:12.081837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-f7cb913a-1221-4f41-8257-d9ef941772c6 req-b4f70b3e-cd09-4a73-9c59-679f89d22815 service nova] Creating event network-vif-plugged:5b1a0fbc-da41-4a91-9ccb-b82810ccd7ef for instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 on hv-cinder-85031 Jul 21 06:31:12.087227 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-f7cb913a-1221-4f41-8257-d9ef941772c6 req-b4f70b3e-cd09-4a73-9c59-679f89d22815 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030488 Jul 21 06:31:12.087842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 70/135] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:31:12.169839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7d3f427d-2a97-4043-9490-1b1b2ec558f1 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:12.171198 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7d3f427d-2a97-4043-9490-1b1b2ec558f1 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:12.177502 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d3f427d-2a97-4043-9490-1b1b2ec558f1 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:12.177975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d3f427d-2a97-4043-9490-1b1b2ec558f1 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:12.179256 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d3f427d-2a97-4043-9490-1b1b2ec558f1 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:12.180286 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d3f427d-2a97-4043-9490-1b1b2ec558f1 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:12.271137 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-737e7daa-8e16-4e94-b187-23c779abcd83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:12.279659 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-737e7daa-8e16-4e94-b187-23c779abcd83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:12.281425 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-737e7daa-8e16-4e94-b187-23c779abcd83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:12.282519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-737e7daa-8e16-4e94-b187-23c779abcd83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.365863 Jul 21 06:31:12.283137 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 66/136] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:11 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:31:12.336590 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7d3f427d-2a97-4043-9490-1b1b2ec558f1 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:12.344719 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7d3f427d-2a97-4043-9490-1b1b2ec558f1 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.179042 Jul 21 06:31:12.345315 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 71/137] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:12 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:12.415888 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2db37362-b309-459b-ae71-c7b29b3bce82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:12.416502 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2db37362-b309-459b-ae71-c7b29b3bce82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:12.422818 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2db37362-b309-459b-ae71-c7b29b3bce82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:12.423267 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2db37362-b309-459b-ae71-c7b29b3bce82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:12.424044 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2db37362-b309-459b-ae71-c7b29b3bce82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:12.424485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2db37362-b309-459b-ae71-c7b29b3bce82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:12.563218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2db37362-b309-459b-ae71-c7b29b3bce82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:12.570689 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2db37362-b309-459b-ae71-c7b29b3bce82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.159193 Jul 21 06:31:12.571260 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 67/138] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:12 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:12.635387 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-121fef5f-a429-41ce-b398-eb829e996b4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:12.636042 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-121fef5f-a429-41ce-b398-eb829e996b4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:12.642061 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-121fef5f-a429-41ce-b398-eb829e996b4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:12.642514 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-121fef5f-a429-41ce-b398-eb829e996b4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:12.643273 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-121fef5f-a429-41ce-b398-eb829e996b4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:12.643711 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-121fef5f-a429-41ce-b398-eb829e996b4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:12.781856 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-121fef5f-a429-41ce-b398-eb829e996b4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:12.790333 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-121fef5f-a429-41ce-b398-eb829e996b4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.159022 Jul 21 06:31:12.790933 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 72/139] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:12 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:12.968342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-54921372-3024-439b-a56e-4c76ea220698 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:12.968954 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-54921372-3024-439b-a56e-4c76ea220698 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:12.975081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-54921372-3024-439b-a56e-4c76ea220698 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:12.975563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-54921372-3024-439b-a56e-4c76ea220698 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:12.976410 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-54921372-3024-439b-a56e-4c76ea220698 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:12.976846 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-54921372-3024-439b-a56e-4c76ea220698 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:13.300628 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a2aad339-eb7c-4a1b-a22a-f09788255d0b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:13.301408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a2aad339-eb7c-4a1b-a22a-f09788255d0b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:13.303431 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:13.311300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a2aad339-eb7c-4a1b-a22a-f09788255d0b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:13.311659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a2aad339-eb7c-4a1b-a22a-f09788255d0b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:13.312437 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a2aad339-eb7c-4a1b-a22a-f09788255d0b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:13.312887 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a2aad339-eb7c-4a1b-a22a-f09788255d0b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:13.321746 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-54921372-3024-439b-a56e-4c76ea220698 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:13.336958 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-54921372-3024-439b-a56e-4c76ea220698 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.371653 Jul 21 06:31:13.340631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 68/140] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:12 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:13.368703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5677cbf4-316c-4924-98e1-d5e48debae41 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:13.369723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5677cbf4-316c-4924-98e1-d5e48debae41 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:13.389511 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5677cbf4-316c-4924-98e1-d5e48debae41 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:13.390013 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5677cbf4-316c-4924-98e1-d5e48debae41 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:13.390832 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5677cbf4-316c-4924-98e1-d5e48debae41 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:13.391373 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5677cbf4-316c-4924-98e1-d5e48debae41 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:13.700170 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a2aad339-eb7c-4a1b-a22a-f09788255d0b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:13.706915 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5677cbf4-316c-4924-98e1-d5e48debae41 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:13.708107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a2aad339-eb7c-4a1b-a22a-f09788255d0b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:13.709602 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a2aad339-eb7c-4a1b-a22a-f09788255d0b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:13.711771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a2aad339-eb7c-4a1b-a22a-f09788255d0b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.415041 Jul 21 06:31:13.712337 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 73/141] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:13 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:31:13.715236 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5677cbf4-316c-4924-98e1-d5e48debae41 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.354823 Jul 21 06:31:13.716017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 69/142] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:13 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:13.716680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b818e942-3634-460f-bc61-7d9f8373ad25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:13.717278 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b818e942-3634-460f-bc61-7d9f8373ad25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:13.723244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b818e942-3634-460f-bc61-7d9f8373ad25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:13.723689 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b818e942-3634-460f-bc61-7d9f8373ad25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:13.724441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b818e942-3634-460f-bc61-7d9f8373ad25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:13.724869 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b818e942-3634-460f-bc61-7d9f8373ad25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:13.808818 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2bfc408b-0105-4f5a-8b49-a65c625f0228 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:13.809642 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2bfc408b-0105-4f5a-8b49-a65c625f0228 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:13.816254 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2bfc408b-0105-4f5a-8b49-a65c625f0228 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:13.816944 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2bfc408b-0105-4f5a-8b49-a65c625f0228 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:13.817870 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2bfc408b-0105-4f5a-8b49-a65c625f0228 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:13.818327 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2bfc408b-0105-4f5a-8b49-a65c625f0228 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:13.876507 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b818e942-3634-460f-bc61-7d9f8373ad25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:13.886903 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b818e942-3634-460f-bc61-7d9f8373ad25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.173533 Jul 21 06:31:13.898649 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 74/143] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:13 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:13.974188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2bfc408b-0105-4f5a-8b49-a65c625f0228 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:13.978707 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-998127912", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "networks": [{"uuid": "fc29e600-c087-44b3-9b0a-d2e20e1a4dac"}]}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:13.982474 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2bfc408b-0105-4f5a-8b49-a65c625f0228 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.177370 Jul 21 06:31:13.983052 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 70/144] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:13 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:14.043734 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.network.neutron [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] validate_networks() for [('fc29e600-c087-44b3-9b0a-d2e20e1a4dac', None, None, None, None, None)] {{(pid=117905) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:31:14.356205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-062f5647-019f-4723-823f-7e729a0ea4d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:14.356809 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-062f5647-019f-4723-823f-7e729a0ea4d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:14.363408 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-062f5647-019f-4723-823f-7e729a0ea4d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:14.363857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-062f5647-019f-4723-823f-7e729a0ea4d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:14.364652 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-062f5647-019f-4723-823f-7e729a0ea4d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:14.365082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-062f5647-019f-4723-823f-7e729a0ea4d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:14.459447 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Flavor limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:31:14.460238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Image limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:31:14.460923 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Flavor pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:31:14.461497 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Image pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:31:14.461974 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:31:14.473348 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:14.474150 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:14.475118 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:14.475752 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:14.495829 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Getting quotas for project e612f06f547449ac9e9b95dcd32d5928. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:31:14.499966 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Getting quotas for user ca97ac5a572b4c52804a26f5e6b8320b and project e612f06f547449ac9e9b95dcd32d5928. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:31:14.521304 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Going to run 1 instances... {{(pid=117905) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:31:14.523871 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:31:14.530061 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-062f5647-019f-4723-823f-7e729a0ea4d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:14.538900 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-062f5647-019f-4723-823f-7e729a0ea4d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.185871 Jul 21 06:31:14.540027 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 71/145] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:14 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:14.576412 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-09776d66-54a1-4c19-93b7-c7b13f224122 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602945 Jul 21 06:31:14.581991 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 75/146] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:31:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:31:14.588513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-50315e4f-8dc0-4d64-8a57-da935fabc4ac tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:14.589741 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-50315e4f-8dc0-4d64-8a57-da935fabc4ac tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:14.649064 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-50315e4f-8dc0-4d64-8a57-da935fabc4ac tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:14.656868 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-50315e4f-8dc0-4d64-8a57-da935fabc4ac tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1213 microversion: 2.1 time: 0.073073 Jul 21 06:31:14.658582 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 72/147] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:14 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:14.731708 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9802170c-fcc2-4ffa-a29e-c4cc87c703f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:14.732372 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d20f830c-3f5d-4a91-bbe2-18e83889d91b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:14.732473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9802170c-fcc2-4ffa-a29e-c4cc87c703f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:14.732988 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d20f830c-3f5d-4a91-bbe2-18e83889d91b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:14.739535 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9802170c-fcc2-4ffa-a29e-c4cc87c703f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:14.740214 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9802170c-fcc2-4ffa-a29e-c4cc87c703f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:14.741088 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9802170c-fcc2-4ffa-a29e-c4cc87c703f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:14.742041 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9802170c-fcc2-4ffa-a29e-c4cc87c703f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:14.748769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d20f830c-3f5d-4a91-bbe2-18e83889d91b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:14.749225 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d20f830c-3f5d-4a91-bbe2-18e83889d91b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:14.750025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d20f830c-3f5d-4a91-bbe2-18e83889d91b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:14.750462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d20f830c-3f5d-4a91-bbe2-18e83889d91b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:14.949394 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9802170c-fcc2-4ffa-a29e-c4cc87c703f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:14.964082 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9802170c-fcc2-4ffa-a29e-c4cc87c703f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:14.965241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d20f830c-3f5d-4a91-bbe2-18e83889d91b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:14.966547 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9802170c-fcc2-4ffa-a29e-c4cc87c703f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:14.969645 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9802170c-fcc2-4ffa-a29e-c4cc87c703f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.242621 Jul 21 06:31:14.970426 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 76/148] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:14 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:14.972976 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d20f830c-3f5d-4a91-bbe2-18e83889d91b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.244285 Jul 21 06:31:14.973547 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 73/149] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:14 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:14.976052 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b3bd1626-e2de-4d13-b2b2-75c5635aa329 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:14.976705 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b3bd1626-e2de-4d13-b2b2-75c5635aa329 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:14.979857 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:14.983722 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b3bd1626-e2de-4d13-b2b2-75c5635aa329 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:14.984170 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b3bd1626-e2de-4d13-b2b2-75c5635aa329 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:14.985281 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b3bd1626-e2de-4d13-b2b2-75c5635aa329 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:14.985393 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b3bd1626-e2de-4d13-b2b2-75c5635aa329 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:15.001758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8f9cb729-eff0-40ac-b1ab-9ab3bab27f42 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:15.003067 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8f9cb729-eff0-40ac-b1ab-9ab3bab27f42 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:15.012556 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8f9cb729-eff0-40ac-b1ab-9ab3bab27f42 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:15.013129 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8f9cb729-eff0-40ac-b1ab-9ab3bab27f42 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:15.014056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8f9cb729-eff0-40ac-b1ab-9ab3bab27f42 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:15.014734 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8f9cb729-eff0-40ac-b1ab-9ab3bab27f42 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:15.227737 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b3bd1626-e2de-4d13-b2b2-75c5635aa329 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:15.229300 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8f9cb729-eff0-40ac-b1ab-9ab3bab27f42 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:15.236179 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b3bd1626-e2de-4d13-b2b2-75c5635aa329 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.264296 Jul 21 06:31:15.236774 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 77/150] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:14 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:15.237163 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8f9cb729-eff0-40ac-b1ab-9ab3bab27f42 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.240560 Jul 21 06:31:15.239014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 74/151] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:14 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:15.556630 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-50a2a0c4-b392-401f-b515-12e1a63a46ad tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:15.557375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-50a2a0c4-b392-401f-b515-12e1a63a46ad tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:15.563571 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50a2a0c4-b392-401f-b515-12e1a63a46ad tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:15.564016 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50a2a0c4-b392-401f-b515-12e1a63a46ad tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:15.564781 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50a2a0c4-b392-401f-b515-12e1a63a46ad tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:15.565210 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50a2a0c4-b392-401f-b515-12e1a63a46ad tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:15.677106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9b4bb13f-bf24-484a-bfd5-89359f8c3512 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:15.677879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9b4bb13f-bf24-484a-bfd5-89359f8c3512 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:15.688837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b4bb13f-bf24-484a-bfd5-89359f8c3512 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:15.692986 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b4bb13f-bf24-484a-bfd5-89359f8c3512 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:15.695320 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b4bb13f-bf24-484a-bfd5-89359f8c3512 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:15.699147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b4bb13f-bf24-484a-bfd5-89359f8c3512 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:15.704623 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-50a2a0c4-b392-401f-b515-12e1a63a46ad tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:15.712709 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-50a2a0c4-b392-401f-b515-12e1a63a46ad tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.161011 Jul 21 06:31:15.713293 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 78/152] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:15 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:15.763790 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9b4bb13f-bf24-484a-bfd5-89359f8c3512 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:15.774950 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9b4bb13f-bf24-484a-bfd5-89359f8c3512 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1217 microversion: 2.1 time: 0.102787 Jul 21 06:31:15.775539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 75/153] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:15 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:15.988662 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3f8f3688-d299-45f0-add1-d837951d5aac tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:15.989576 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3f8f3688-d299-45f0-add1-d837951d5aac tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:15.990094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-51b4eb53-4241-42ac-b0c1-6ab03b6f20f3 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:15.990911 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-51b4eb53-4241-42ac-b0c1-6ab03b6f20f3 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:15.996841 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3f8f3688-d299-45f0-add1-d837951d5aac tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:15.996973 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-51b4eb53-4241-42ac-b0c1-6ab03b6f20f3 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:15.997424 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-51b4eb53-4241-42ac-b0c1-6ab03b6f20f3 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:15.998118 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3f8f3688-d299-45f0-add1-d837951d5aac tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:15.998215 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-51b4eb53-4241-42ac-b0c1-6ab03b6f20f3 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:15.998313 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3f8f3688-d299-45f0-add1-d837951d5aac tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:15.998637 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-51b4eb53-4241-42ac-b0c1-6ab03b6f20f3 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:15.998899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3f8f3688-d299-45f0-add1-d837951d5aac tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:16.202622 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-51b4eb53-4241-42ac-b0c1-6ab03b6f20f3 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:16.210737 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-51b4eb53-4241-42ac-b0c1-6ab03b6f20f3 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.224208 Jul 21 06:31:16.211313 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 76/154] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:15 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:16.212375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3f8f3688-d299-45f0-add1-d837951d5aac tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:16.229230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3f8f3688-d299-45f0-add1-d837951d5aac tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:16.231143 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3f8f3688-d299-45f0-add1-d837951d5aac tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:16.232498 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3f8f3688-d299-45f0-add1-d837951d5aac tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.247884 Jul 21 06:31:16.233223 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 79/155] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:15 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:16.253167 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bec78ff1-9f7a-4567-a129-6e1ee3762b0e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:16.254015 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bec78ff1-9f7a-4567-a129-6e1ee3762b0e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:16.258971 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-aaea5e24-b518-4ff7-9a4f-65b47647a934 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:16.259805 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-aaea5e24-b518-4ff7-9a4f-65b47647a934 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:16.260780 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bec78ff1-9f7a-4567-a129-6e1ee3762b0e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:16.261483 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bec78ff1-9f7a-4567-a129-6e1ee3762b0e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:16.262509 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bec78ff1-9f7a-4567-a129-6e1ee3762b0e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:16.263052 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bec78ff1-9f7a-4567-a129-6e1ee3762b0e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:16.267562 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aaea5e24-b518-4ff7-9a4f-65b47647a934 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:16.268020 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aaea5e24-b518-4ff7-9a4f-65b47647a934 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:16.268796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aaea5e24-b518-4ff7-9a4f-65b47647a934 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:16.269232 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aaea5e24-b518-4ff7-9a4f-65b47647a934 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:16.484208 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bec78ff1-9f7a-4567-a129-6e1ee3762b0e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:16.497042 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-aaea5e24-b518-4ff7-9a4f-65b47647a934 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:16.499277 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bec78ff1-9f7a-4567-a129-6e1ee3762b0e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.249825 Jul 21 06:31:16.500089 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 77/156] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:16 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:16.505545 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-aaea5e24-b518-4ff7-9a4f-65b47647a934 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.252513 Jul 21 06:31:16.507732 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 80/157] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:16 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:16.729931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e9e59b4b-b940-43cf-bb07-0f45ec8ae36f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:16.730652 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e9e59b4b-b940-43cf-bb07-0f45ec8ae36f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:16.746685 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9e59b4b-b940-43cf-bb07-0f45ec8ae36f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:16.747379 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9e59b4b-b940-43cf-bb07-0f45ec8ae36f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:16.748647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9e59b4b-b940-43cf-bb07-0f45ec8ae36f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:16.749438 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9e59b4b-b940-43cf-bb07-0f45ec8ae36f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:16.797273 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fc77aa83-27f6-4d91-8fc9-664e8105d8f3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:16.798557 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fc77aa83-27f6-4d91-8fc9-664e8105d8f3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:16.805758 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc77aa83-27f6-4d91-8fc9-664e8105d8f3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:16.806541 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc77aa83-27f6-4d91-8fc9-664e8105d8f3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:16.807553 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc77aa83-27f6-4d91-8fc9-664e8105d8f3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:16.818338 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc77aa83-27f6-4d91-8fc9-664e8105d8f3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:16.957403 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fc77aa83-27f6-4d91-8fc9-664e8105d8f3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:16.967233 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fc77aa83-27f6-4d91-8fc9-664e8105d8f3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1217 microversion: 2.1 time: 0.175020 Jul 21 06:31:16.967828 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 81/158] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:16 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:16.980443 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-29215f55-93c1-4281-a104-12bcce045fe8 req-2cdd5f5f-3ded-4f7f-8579-136d0d09866e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40d32b1-a161-49f9-a2ae-fe794e9a66cd", "name": "network-vif-plugged", "status": "completed", "tag": "345fc32c-f55c-4636-be16-4b276cd0c105"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:16.998272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-29215f55-93c1-4281-a104-12bcce045fe8 req-2cdd5f5f-3ded-4f7f-8579-136d0d09866e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:16.998888 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-29215f55-93c1-4281-a104-12bcce045fe8 req-2cdd5f5f-3ded-4f7f-8579-136d0d09866e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:17.037757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-29215f55-93c1-4281-a104-12bcce045fe8 req-2cdd5f5f-3ded-4f7f-8579-136d0d09866e service nova] Creating event network-vif-plugged:345fc32c-f55c-4636-be16-4b276cd0c105 for instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd on hv-cinder-85031 Jul 21 06:31:17.049779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-29215f55-93c1-4281-a104-12bcce045fe8 req-2cdd5f5f-3ded-4f7f-8579-136d0d09866e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080365 Jul 21 06:31:17.052208 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 82/159] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:17.056879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e9e59b4b-b940-43cf-bb07-0f45ec8ae36f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:17.066286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e9e59b4b-b940-43cf-bb07-0f45ec8ae36f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.340395 Jul 21 06:31:17.066856 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 78/160] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:16 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:17.229370 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e29d5150-7cb0-4436-9f03-92f191fcc48f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:17.230655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e29d5150-7cb0-4436-9f03-92f191fcc48f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:17.237680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e29d5150-7cb0-4436-9f03-92f191fcc48f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:17.238398 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e29d5150-7cb0-4436-9f03-92f191fcc48f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:17.239406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e29d5150-7cb0-4436-9f03-92f191fcc48f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:17.240107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e29d5150-7cb0-4436-9f03-92f191fcc48f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:17.252503 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e5c20a58-d2d2-4700-9b4d-65c0d54836d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:17.254385 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e5c20a58-d2d2-4700-9b4d-65c0d54836d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:17.268750 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e5c20a58-d2d2-4700-9b4d-65c0d54836d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:17.269541 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e5c20a58-d2d2-4700-9b4d-65c0d54836d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:17.275202 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e5c20a58-d2d2-4700-9b4d-65c0d54836d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:17.276351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e5c20a58-d2d2-4700-9b4d-65c0d54836d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:17.281694 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:17.480021 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e29d5150-7cb0-4436-9f03-92f191fcc48f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:17.488756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e29d5150-7cb0-4436-9f03-92f191fcc48f tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.264778 Jul 21 06:31:17.489344 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 83/161] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:17 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:17.497457 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e5c20a58-d2d2-4700-9b4d-65c0d54836d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:17.506629 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e5c20a58-d2d2-4700-9b4d-65c0d54836d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:17.509010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e5c20a58-d2d2-4700-9b4d-65c0d54836d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:17.510185 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e5c20a58-d2d2-4700-9b4d-65c0d54836d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.262175 Jul 21 06:31:17.510763 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 79/162] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:17 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:31:17.524926 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bdbf0ef0-6e9c-4f05-97d3-1645e1bba033 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:17.525116 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2ba23aa5-2a16-43ba-a304-081077c3117a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:17.525532 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bdbf0ef0-6e9c-4f05-97d3-1645e1bba033 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:17.526174 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2ba23aa5-2a16-43ba-a304-081077c3117a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:17.532562 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ba23aa5-2a16-43ba-a304-081077c3117a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:17.532910 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bdbf0ef0-6e9c-4f05-97d3-1645e1bba033 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:17.533057 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ba23aa5-2a16-43ba-a304-081077c3117a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:17.533360 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bdbf0ef0-6e9c-4f05-97d3-1645e1bba033 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:17.533750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ba23aa5-2a16-43ba-a304-081077c3117a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:17.534159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bdbf0ef0-6e9c-4f05-97d3-1645e1bba033 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:17.534566 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ba23aa5-2a16-43ba-a304-081077c3117a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:17.534676 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bdbf0ef0-6e9c-4f05-97d3-1645e1bba033 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:17.745165 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bdbf0ef0-6e9c-4f05-97d3-1645e1bba033 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:17.756421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2ba23aa5-2a16-43ba-a304-081077c3117a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:17.778264 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2ba23aa5-2a16-43ba-a304-081077c3117a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1322 microversion: 2.1 time: 0.258613 Jul 21 06:31:17.782517 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bdbf0ef0-6e9c-4f05-97d3-1645e1bba033 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.252132 Jul 21 06:31:17.783589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 84/163] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:17 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:17.784489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 80/164] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:17 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:17.987955 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ba3a64d5-bb84-4f7d-9af5-bd40f78ef2e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:17.989401 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ba3a64d5-bb84-4f7d-9af5-bd40f78ef2e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:17.998124 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ba3a64d5-bb84-4f7d-9af5-bd40f78ef2e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.000019 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ba3a64d5-bb84-4f7d-9af5-bd40f78ef2e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.000827 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ba3a64d5-bb84-4f7d-9af5-bd40f78ef2e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.001272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ba3a64d5-bb84-4f7d-9af5-bd40f78ef2e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.081785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ba3a64d5-bb84-4f7d-9af5-bd40f78ef2e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:18.083453 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-660a697f-33e5-4236-97c3-195d1e4c3768 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:18.084687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-660a697f-33e5-4236-97c3-195d1e4c3768 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:18.093407 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ba3a64d5-bb84-4f7d-9af5-bd40f78ef2e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1209 microversion: 2.1 time: 0.109222 Jul 21 06:31:18.094242 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 85/165] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:17 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:18.099918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-660a697f-33e5-4236-97c3-195d1e4c3768 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.101619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-660a697f-33e5-4236-97c3-195d1e4c3768 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.102726 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-660a697f-33e5-4236-97c3-195d1e4c3768 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.103564 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-660a697f-33e5-4236-97c3-195d1e4c3768 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.134400 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:18.311628 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-660a697f-33e5-4236-97c3-195d1e4c3768 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:18.320494 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-660a697f-33e5-4236-97c3-195d1e4c3768 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.241451 Jul 21 06:31:18.321316 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 81/166] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:18 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:18.506867 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8d591913-19d6-4b0b-9f92-080afe58350b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:18.507478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8d591913-19d6-4b0b-9f92-080afe58350b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:18.513512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d591913-19d6-4b0b-9f92-080afe58350b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.514030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d591913-19d6-4b0b-9f92-080afe58350b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.514833 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d591913-19d6-4b0b-9f92-080afe58350b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.515327 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d591913-19d6-4b0b-9f92-080afe58350b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.530004 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dd259447-55c5-403c-91b1-99bb59e055eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:18.531313 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dd259447-55c5-403c-91b1-99bb59e055eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:18.540024 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd259447-55c5-403c-91b1-99bb59e055eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.540853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd259447-55c5-403c-91b1-99bb59e055eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.542097 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd259447-55c5-403c-91b1-99bb59e055eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.542531 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd259447-55c5-403c-91b1-99bb59e055eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.736783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8d591913-19d6-4b0b-9f92-080afe58350b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:18.743215 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dd259447-55c5-403c-91b1-99bb59e055eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:18.745902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8d591913-19d6-4b0b-9f92-080afe58350b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.242671 Jul 21 06:31:18.753279 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 86/167] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:18 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:18.759208 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dd259447-55c5-403c-91b1-99bb59e055eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:18.761540 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dd259447-55c5-403c-91b1-99bb59e055eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:18.762730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dd259447-55c5-403c-91b1-99bb59e055eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.237299 Jul 21 06:31:18.763368 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 82/168] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:18 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:18.801509 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a25c3664-3a4b-43ab-99c8-801469942f4a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:18.802248 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a25c3664-3a4b-43ab-99c8-801469942f4a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:18.805554 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6b4361a2-d33c-432e-b775-5b7f9df6253c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:18.806436 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6b4361a2-d33c-432e-b775-5b7f9df6253c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:18.808886 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a25c3664-3a4b-43ab-99c8-801469942f4a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.809402 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a25c3664-3a4b-43ab-99c8-801469942f4a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.810291 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a25c3664-3a4b-43ab-99c8-801469942f4a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.810812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a25c3664-3a4b-43ab-99c8-801469942f4a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.813279 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b4361a2-d33c-432e-b775-5b7f9df6253c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.813965 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b4361a2-d33c-432e-b775-5b7f9df6253c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:18.814860 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b4361a2-d33c-432e-b775-5b7f9df6253c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:18.815292 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b4361a2-d33c-432e-b775-5b7f9df6253c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:19.315617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a25c3664-3a4b-43ab-99c8-801469942f4a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:19.323180 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6b4361a2-d33c-432e-b775-5b7f9df6253c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:19.331237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6b4361a2-d33c-432e-b775-5b7f9df6253c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.530090 Jul 21 06:31:19.333925 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 83/169] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:18 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:19.338418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a25c3664-3a4b-43ab-99c8-801469942f4a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1516 microversion: 2.1 time: 0.539608 Jul 21 06:31:19.338418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 87/170] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:18 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1516 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:19.345336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9c4e6a0d-e783-4998-b72d-ab5af26015a8 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:19.354531 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1872ea39-347e-40d0-a6b6-48a939d1274e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:19.355145 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1872ea39-347e-40d0-a6b6-48a939d1274e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:19.361159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9c4e6a0d-e783-4998-b72d-ab5af26015a8 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:19.365775 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1872ea39-347e-40d0-a6b6-48a939d1274e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:19.367163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1872ea39-347e-40d0-a6b6-48a939d1274e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:19.368192 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1872ea39-347e-40d0-a6b6-48a939d1274e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:19.368687 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1872ea39-347e-40d0-a6b6-48a939d1274e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:19.370335 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9c4e6a0d-e783-4998-b72d-ab5af26015a8 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:19.370793 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9c4e6a0d-e783-4998-b72d-ab5af26015a8 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:19.371565 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9c4e6a0d-e783-4998-b72d-ab5af26015a8 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:19.371999 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9c4e6a0d-e783-4998-b72d-ab5af26015a8 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:19.473214 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9c4e6a0d-e783-4998-b72d-ab5af26015a8 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:19.489206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9c4e6a0d-e783-4998-b72d-ab5af26015a8 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1209 microversion: 2.1 time: 0.147577 Jul 21 06:31:19.489782 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 84/171] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:19 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1209 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:19.494993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-cd5d804d-d178-41e9-8fe9-3e6bb587eca1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:19.496211 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-cd5d804d-d178-41e9-8fe9-3e6bb587eca1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:19.502930 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cd5d804d-d178-41e9-8fe9-3e6bb587eca1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:19.503545 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cd5d804d-d178-41e9-8fe9-3e6bb587eca1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:19.504477 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cd5d804d-d178-41e9-8fe9-3e6bb587eca1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:19.505064 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cd5d804d-d178-41e9-8fe9-3e6bb587eca1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:19.577145 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-cd5d804d-d178-41e9-8fe9-3e6bb587eca1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lazy-loading 'flavor' on Instance uuid 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:31:19.594725 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1872ea39-347e-40d0-a6b6-48a939d1274e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:19.603242 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1872ea39-347e-40d0-a6b6-48a939d1274e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.252717 Jul 21 06:31:19.604369 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 88/172] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:19 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:19.733717 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-cd5d804d-d178-41e9-8fe9-3e6bb587eca1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4/action" status: 200 len: 32 microversion: 2.1 time: 0.242411 Jul 21 06:31:19.735961 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 85/173] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:31:19 2022] POST /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4/action => generated 32 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:31:19.746705 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2289891c-5fbb-47a0-a1fe-09eef6b07331 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:19.747494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2289891c-5fbb-47a0-a1fe-09eef6b07331 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:19.762451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2289891c-5fbb-47a0-a1fe-09eef6b07331 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:19.762984 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2289891c-5fbb-47a0-a1fe-09eef6b07331 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:19.763900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2289891c-5fbb-47a0-a1fe-09eef6b07331 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:19.764803 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e33c504c-2226-4b0a-b0c1-4848e6a7e775 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:19.765446 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2289891c-5fbb-47a0-a1fe-09eef6b07331 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:19.765879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e33c504c-2226-4b0a-b0c1-4848e6a7e775 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:19.772934 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e33c504c-2226-4b0a-b0c1-4848e6a7e775 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:19.773466 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e33c504c-2226-4b0a-b0c1-4848e6a7e775 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:19.774357 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e33c504c-2226-4b0a-b0c1-4848e6a7e775 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:19.774857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e33c504c-2226-4b0a-b0c1-4848e6a7e775 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:20.014353 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2289891c-5fbb-47a0-a1fe-09eef6b07331 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:20.023949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2289891c-5fbb-47a0-a1fe-09eef6b07331 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.280997 Jul 21 06:31:20.025016 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 89/174] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:19 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:20.030125 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e33c504c-2226-4b0a-b0c1-4848e6a7e775 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:20.030856 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-360afbcc-ce8d-4fe7-bb75-a1e5a2799fd0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:20.031675 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-360afbcc-ce8d-4fe7-bb75-a1e5a2799fd0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:20.048675 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e33c504c-2226-4b0a-b0c1-4848e6a7e775 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1314 microversion: 2.1 time: 0.288213 Jul 21 06:31:20.049642 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 86/175] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:19 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:20.060225 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-360afbcc-ce8d-4fe7-bb75-a1e5a2799fd0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:20.060684 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-360afbcc-ce8d-4fe7-bb75-a1e5a2799fd0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:20.061468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-360afbcc-ce8d-4fe7-bb75-a1e5a2799fd0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:20.061900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-360afbcc-ce8d-4fe7-bb75-a1e5a2799fd0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:20.064609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-7434204c-8db8-45aa-bad3-0fee4acaffd4 req-f06000fb-3c7d-4b7a-89a7-01c8637f96b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7788e87-32b8-4250-bae6-b666d958ab97", "name": "network-vif-plugged", "status": "completed", "tag": "64c03855-c1db-478e-916b-e86e4f9e9bdc"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:20.073457 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-7434204c-8db8-45aa-bad3-0fee4acaffd4 req-f06000fb-3c7d-4b7a-89a7-01c8637f96b4 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:20.074027 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-7434204c-8db8-45aa-bad3-0fee4acaffd4 req-f06000fb-3c7d-4b7a-89a7-01c8637f96b4 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:20.086070 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-7434204c-8db8-45aa-bad3-0fee4acaffd4 req-f06000fb-3c7d-4b7a-89a7-01c8637f96b4 service nova] Creating event network-vif-plugged:64c03855-c1db-478e-916b-e86e4f9e9bdc for instance e7788e87-32b8-4250-bae6-b666d958ab97 on hv-cinder-85031 Jul 21 06:31:20.093157 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-7434204c-8db8-45aa-bad3-0fee4acaffd4 req-f06000fb-3c7d-4b7a-89a7-01c8637f96b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032740 Jul 21 06:31:20.094442 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 87/176] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:20.301064 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-360afbcc-ce8d-4fe7-bb75-a1e5a2799fd0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:20.309089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-360afbcc-ce8d-4fe7-bb75-a1e5a2799fd0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:20.310635 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-360afbcc-ce8d-4fe7-bb75-a1e5a2799fd0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:20.311739 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-360afbcc-ce8d-4fe7-bb75-a1e5a2799fd0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.285606 Jul 21 06:31:20.312290 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 90/177] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:20 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:20.351821 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-da30b909-6599-4e5a-bbbd-df7a2462fdf7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:20.352527 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-da30b909-6599-4e5a-bbbd-df7a2462fdf7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:20.358804 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-da30b909-6599-4e5a-bbbd-df7a2462fdf7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:20.359251 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-da30b909-6599-4e5a-bbbd-df7a2462fdf7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:20.360015 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-da30b909-6599-4e5a-bbbd-df7a2462fdf7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:20.360456 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-da30b909-6599-4e5a-bbbd-df7a2462fdf7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:20.494210 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-da30b909-6599-4e5a-bbbd-df7a2462fdf7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:20.501554 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-da30b909-6599-4e5a-bbbd-df7a2462fdf7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.154655 Jul 21 06:31:20.502279 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 88/178] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:20 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:20.508133 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-bdc239cf-9095-43d3-ae57-67946e0140f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:20.508877 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-bdc239cf-9095-43d3-ae57-67946e0140f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:20.514937 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdc239cf-9095-43d3-ae57-67946e0140f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:20.515543 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdc239cf-9095-43d3-ae57-67946e0140f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:20.516312 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdc239cf-9095-43d3-ae57-67946e0140f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:20.516752 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdc239cf-9095-43d3-ae57-67946e0140f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:20.582567 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bdc239cf-9095-43d3-ae57-67946e0140f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:20.590824 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-bdc239cf-9095-43d3-ae57-67946e0140f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1209 microversion: 2.1 time: 0.087897 Jul 21 06:31:20.591408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 91/179] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:20 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:20.620991 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7adeaad5-c47f-45c4-a50b-226f0cd68349 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:20.621611 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7adeaad5-c47f-45c4-a50b-226f0cd68349 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:20.627965 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7adeaad5-c47f-45c4-a50b-226f0cd68349 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:20.628671 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7adeaad5-c47f-45c4-a50b-226f0cd68349 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:20.629765 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7adeaad5-c47f-45c4-a50b-226f0cd68349 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:20.630413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7adeaad5-c47f-45c4-a50b-226f0cd68349 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:20.794423 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7adeaad5-c47f-45c4-a50b-226f0cd68349 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:20.802435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7adeaad5-c47f-45c4-a50b-226f0cd68349 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.185549 Jul 21 06:31:20.802997 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 89/180] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:20 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:21.042243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-367d03b6-495f-4479-bb1c-5182717d54c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:21.043244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-367d03b6-495f-4479-bb1c-5182717d54c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:21.049736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-367d03b6-495f-4479-bb1c-5182717d54c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.050465 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-367d03b6-495f-4479-bb1c-5182717d54c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.057340 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-367d03b6-495f-4479-bb1c-5182717d54c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.057340 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-367d03b6-495f-4479-bb1c-5182717d54c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.066924 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-99dbd924-1b98-4581-a23f-5b501c1e634b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:21.067867 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-99dbd924-1b98-4581-a23f-5b501c1e634b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:21.084157 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-99dbd924-1b98-4581-a23f-5b501c1e634b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.084617 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-99dbd924-1b98-4581-a23f-5b501c1e634b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.085440 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-99dbd924-1b98-4581-a23f-5b501c1e634b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.088254 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-99dbd924-1b98-4581-a23f-5b501c1e634b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.410332 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-99dbd924-1b98-4581-a23f-5b501c1e634b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:21.413988 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-367d03b6-495f-4479-bb1c-5182717d54c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:21.420824 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-99dbd924-1b98-4581-a23f-5b501c1e634b tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1501 microversion: 2.1 time: 0.358533 Jul 21 06:31:21.421815 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 90/181] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:21 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1501 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:21.421930 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-367d03b6-495f-4479-bb1c-5182717d54c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.383581 Jul 21 06:31:21.422378 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 92/182] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:21 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:21.432901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c88e0bd3-e454-4df3-ae95-b3462ed54525 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:21.433746 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c88e0bd3-e454-4df3-ae95-b3462ed54525 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:21.442854 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c88e0bd3-e454-4df3-ae95-b3462ed54525 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.443462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c88e0bd3-e454-4df3-ae95-b3462ed54525 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.444723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c88e0bd3-e454-4df3-ae95-b3462ed54525 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.445321 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c88e0bd3-e454-4df3-ae95-b3462ed54525 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.520519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e8efa420-f2f5-4523-bbc5-99486cba7a50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:21.522118 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e8efa420-f2f5-4523-bbc5-99486cba7a50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:21.534507 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e8efa420-f2f5-4523-bbc5-99486cba7a50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.535685 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e8efa420-f2f5-4523-bbc5-99486cba7a50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.536751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e8efa420-f2f5-4523-bbc5-99486cba7a50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.537617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e8efa420-f2f5-4523-bbc5-99486cba7a50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.786926 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c88e0bd3-e454-4df3-ae95-b3462ed54525 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:21.795883 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c88e0bd3-e454-4df3-ae95-b3462ed54525 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:21.797387 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c88e0bd3-e454-4df3-ae95-b3462ed54525 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:21.799258 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c88e0bd3-e454-4df3-ae95-b3462ed54525 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1407 microversion: 2.20 time: 0.371472 Jul 21 06:31:21.799935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 91/183] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:21 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:21.805721 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3012b19b-5646-495f-90ee-7e5ec4dcad07 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:21.806429 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3012b19b-5646-495f-90ee-7e5ec4dcad07 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:21.815604 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3012b19b-5646-495f-90ee-7e5ec4dcad07 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.816054 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3012b19b-5646-495f-90ee-7e5ec4dcad07 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.822103 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3012b19b-5646-495f-90ee-7e5ec4dcad07 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.822568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3012b19b-5646-495f-90ee-7e5ec4dcad07 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.882828 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e8efa420-f2f5-4523-bbc5-99486cba7a50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:21.890494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e8efa420-f2f5-4523-bbc5-99486cba7a50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.374953 Jul 21 06:31:21.891106 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 93/184] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:21 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:21.895525 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-24d36247-45bd-4b74-90a1-066740a15b22 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:21.896137 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-24d36247-45bd-4b74-90a1-066740a15b22 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:21.902657 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-24d36247-45bd-4b74-90a1-066740a15b22 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.903089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-24d36247-45bd-4b74-90a1-066740a15b22 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.903855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-24d36247-45bd-4b74-90a1-066740a15b22 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:21.904408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-24d36247-45bd-4b74-90a1-066740a15b22 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:21.907339 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3012b19b-5646-495f-90ee-7e5ec4dcad07 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:21.915493 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3012b19b-5646-495f-90ee-7e5ec4dcad07 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1265 microversion: 2.1 time: 0.114212 Jul 21 06:31:21.916268 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 92/185] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:21 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:22.108830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-24d36247-45bd-4b74-90a1-066740a15b22 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:22.118449 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-24d36247-45bd-4b74-90a1-066740a15b22 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.226299 Jul 21 06:31:22.119043 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 94/186] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:21 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:22.124635 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-c3273c52-eea5-4970-ae9f-1fbffe8b6010 req-8db0b4e3-d9c9-4e8e-9b3d-5ac5488fbcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f81355-5e49-4559-b29c-b6faefe880b7", "name": "network-vif-plugged", "status": "completed", "tag": "0004c418-8336-40b0-9995-58b47e33de84"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:22.133225 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-c3273c52-eea5-4970-ae9f-1fbffe8b6010 req-8db0b4e3-d9c9-4e8e-9b3d-5ac5488fbcb0 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:22.133667 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-c3273c52-eea5-4970-ae9f-1fbffe8b6010 req-8db0b4e3-d9c9-4e8e-9b3d-5ac5488fbcb0 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:22.150479 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-c3273c52-eea5-4970-ae9f-1fbffe8b6010 req-8db0b4e3-d9c9-4e8e-9b3d-5ac5488fbcb0 service nova] Creating event network-vif-plugged:0004c418-8336-40b0-9995-58b47e33de84 for instance 43f81355-5e49-4559-b29c-b6faefe880b7 on hv-cinder-85031 Jul 21 06:31:22.155774 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-c3273c52-eea5-4970-ae9f-1fbffe8b6010 req-8db0b4e3-d9c9-4e8e-9b3d-5ac5488fbcb0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034687 Jul 21 06:31:22.156372 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 93/187] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:31:22.443583 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a891f5b4-894d-48d6-ba69-f86819ca7401 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:22.454756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a891f5b4-894d-48d6-ba69-f86819ca7401 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:22.464867 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a891f5b4-894d-48d6-ba69-f86819ca7401 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:22.465308 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a891f5b4-894d-48d6-ba69-f86819ca7401 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:22.468399 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a891f5b4-894d-48d6-ba69-f86819ca7401 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:22.468851 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a891f5b4-894d-48d6-ba69-f86819ca7401 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:22.725254 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a891f5b4-894d-48d6-ba69-f86819ca7401 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:22.733345 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a891f5b4-894d-48d6-ba69-f86819ca7401 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.293999 Jul 21 06:31:22.733981 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 95/188] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:22 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:22.818381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d2c308c0-1bcf-4d95-8882-0f7cc03e9dad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:22.819293 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d2c308c0-1bcf-4d95-8882-0f7cc03e9dad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:22.825475 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d2c308c0-1bcf-4d95-8882-0f7cc03e9dad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:22.825925 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d2c308c0-1bcf-4d95-8882-0f7cc03e9dad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:22.826717 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d2c308c0-1bcf-4d95-8882-0f7cc03e9dad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:22.827149 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d2c308c0-1bcf-4d95-8882-0f7cc03e9dad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:22.895260 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fd546ec8-cea1-4623-aae3-1bf3a8a35542 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcc2aa73-6bd8-4171-a2cf-55a2a3c2ad8e"}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:22.896486 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fd546ec8-cea1-4623-aae3-1bf3a8a35542 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:22.903581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fd546ec8-cea1-4623-aae3-1bf3a8a35542 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:22.903770 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fd546ec8-cea1-4623-aae3-1bf3a8a35542 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:22.904536 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fd546ec8-cea1-4623-aae3-1bf3a8a35542 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:22.904974 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fd546ec8-cea1-4623-aae3-1bf3a8a35542 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:22.968632 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d2c308c0-1bcf-4d95-8882-0f7cc03e9dad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:22.977377 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d2c308c0-1bcf-4d95-8882-0f7cc03e9dad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:22.978831 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d2c308c0-1bcf-4d95-8882-0f7cc03e9dad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:22.979988 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d2c308c0-1bcf-4d95-8882-0f7cc03e9dad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1600 microversion: 2.20 time: 0.165911 Jul 21 06:31:22.980549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 94/189] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:31:22 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:31:22.987728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8c4e7ed5-7cb5-472b-a53a-18a2f5aa69e2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:22.988509 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8c4e7ed5-7cb5-472b-a53a-18a2f5aa69e2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:22.996077 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c4e7ed5-7cb5-472b-a53a-18a2f5aa69e2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:22.996655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c4e7ed5-7cb5-472b-a53a-18a2f5aa69e2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:22.997496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c4e7ed5-7cb5-472b-a53a-18a2f5aa69e2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:22.998041 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c4e7ed5-7cb5-472b-a53a-18a2f5aa69e2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:23.146248 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8c4e7ed5-7cb5-472b-a53a-18a2f5aa69e2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:23.155124 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8c4e7ed5-7cb5-472b-a53a-18a2f5aa69e2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.173332 Jul 21 06:31:23.156072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 95/190] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:22 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:23.161020 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d48bb862-6ad1-44bc-9865-c3bbbe768ffd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:23.161796 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d48bb862-6ad1-44bc-9865-c3bbbe768ffd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:23.168923 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d48bb862-6ad1-44bc-9865-c3bbbe768ffd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:23.169454 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d48bb862-6ad1-44bc-9865-c3bbbe768ffd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:23.170340 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d48bb862-6ad1-44bc-9865-c3bbbe768ffd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:23.170849 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d48bb862-6ad1-44bc-9865-c3bbbe768ffd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:23.241577 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d48bb862-6ad1-44bc-9865-c3bbbe768ffd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:23.249788 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d48bb862-6ad1-44bc-9865-c3bbbe768ffd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1273 microversion: 2.1 time: 0.092574 Jul 21 06:31:23.250662 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 96/191] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:23 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:23.257791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6a29cff3-41ea-46e1-aee4-9a210452125e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:23.258552 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6a29cff3-41ea-46e1-aee4-9a210452125e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:23.264638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6a29cff3-41ea-46e1-aee4-9a210452125e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:23.265161 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6a29cff3-41ea-46e1-aee4-9a210452125e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:23.266028 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6a29cff3-41ea-46e1-aee4-9a210452125e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:23.266537 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6a29cff3-41ea-46e1-aee4-9a210452125e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:23.286036 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:23.362091 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6a29cff3-41ea-46e1-aee4-9a210452125e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.108747 Jul 21 06:31:23.362706 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 97/192] 10.222.0.42 () {60 vars in 1315 bytes} [Thu Jul 21 06:31:23 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:31:23.367860 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-76cb37b0-0335-4dc5-b932-ebefab8188c0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:23.368480 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-76cb37b0-0335-4dc5-b932-ebefab8188c0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:23.374961 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76cb37b0-0335-4dc5-b932-ebefab8188c0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:23.375631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76cb37b0-0335-4dc5-b932-ebefab8188c0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:23.376409 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76cb37b0-0335-4dc5-b932-ebefab8188c0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:23.377209 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76cb37b0-0335-4dc5-b932-ebefab8188c0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:23.674959 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-76cb37b0-0335-4dc5-b932-ebefab8188c0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:23.683214 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-76cb37b0-0335-4dc5-b932-ebefab8188c0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.319525 Jul 21 06:31:23.683789 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 98/193] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:23 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:23.751286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-10e4e8d7-7056-4404-af96-50d9911f651c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:23.751802 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-10e4e8d7-7056-4404-af96-50d9911f651c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:23.757748 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10e4e8d7-7056-4404-af96-50d9911f651c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:23.758217 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10e4e8d7-7056-4404-af96-50d9911f651c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:23.758968 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10e4e8d7-7056-4404-af96-50d9911f651c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:23.759392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10e4e8d7-7056-4404-af96-50d9911f651c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:24.278651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-10e4e8d7-7056-4404-af96-50d9911f651c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:24.286217 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-10e4e8d7-7056-4404-af96-50d9911f651c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.538769 Jul 21 06:31:24.286795 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 99/194] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:23 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:24.291311 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-36b84c5d-f5a0-42f6-a8b4-8e2a950e9c00 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:24.291919 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-36b84c5d-f5a0-42f6-a8b4-8e2a950e9c00 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:24.297790 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-36b84c5d-f5a0-42f6-a8b4-8e2a950e9c00 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:24.298299 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-36b84c5d-f5a0-42f6-a8b4-8e2a950e9c00 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:24.299125 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-36b84c5d-f5a0-42f6-a8b4-8e2a950e9c00 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:24.299565 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-36b84c5d-f5a0-42f6-a8b4-8e2a950e9c00 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:24.485842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:24.507440 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=6 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:24.552504 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-36b84c5d-f5a0-42f6-a8b4-8e2a950e9c00 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:24.560176 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-36b84c5d-f5a0-42f6-a8b4-8e2a950e9c00 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.272421 Jul 21 06:31:24.560747 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 100/195] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:24 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:24.565066 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-14855c13-71f7-43d3-a7b9-52935bc3254e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:24.565663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-14855c13-71f7-43d3-a7b9-52935bc3254e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:24.572741 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-14855c13-71f7-43d3-a7b9-52935bc3254e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:24.573183 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-14855c13-71f7-43d3-a7b9-52935bc3254e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:24.573997 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-14855c13-71f7-43d3-a7b9-52935bc3254e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:24.574428 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-14855c13-71f7-43d3-a7b9-52935bc3254e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:24.641563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-14855c13-71f7-43d3-a7b9-52935bc3254e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:24.649382 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-14855c13-71f7-43d3-a7b9-52935bc3254e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1273 microversion: 2.1 time: 0.087626 Jul 21 06:31:24.650140 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 101/196] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:24 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:24.700552 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d1874e9c-6b3c-4b24-9164-52f9d5f30ed0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:24.701170 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d1874e9c-6b3c-4b24-9164-52f9d5f30ed0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:24.703066 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:24.708411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d1874e9c-6b3c-4b24-9164-52f9d5f30ed0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:24.708884 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d1874e9c-6b3c-4b24-9164-52f9d5f30ed0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:24.709687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d1874e9c-6b3c-4b24-9164-52f9d5f30ed0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:24.710166 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d1874e9c-6b3c-4b24-9164-52f9d5f30ed0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:24.891109 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d1874e9c-6b3c-4b24-9164-52f9d5f30ed0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:24.899246 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d1874e9c-6b3c-4b24-9164-52f9d5f30ed0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.203311 Jul 21 06:31:24.899828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 102/197] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:24 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:25.030868 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-deae7241-3416-43d9-8604-8b93f1b448e6 req-93d35614-27e3-4c21-b979-395ed4b3431c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a40d32b1-a161-49f9-a2ae-fe794e9a66cd", "tag": "345fc32c-f55c-4636-be16-4b276cd0c105"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:25.039430 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-deae7241-3416-43d9-8604-8b93f1b448e6 req-93d35614-27e3-4c21-b979-395ed4b3431c service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:25.039808 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-deae7241-3416-43d9-8604-8b93f1b448e6 req-93d35614-27e3-4c21-b979-395ed4b3431c service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:25.052555 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-deae7241-3416-43d9-8604-8b93f1b448e6 req-93d35614-27e3-4c21-b979-395ed4b3431c service nova] Creating event network-changed:345fc32c-f55c-4636-be16-4b276cd0c105 for instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd on hv-cinder-85031 Jul 21 06:31:25.059814 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-deae7241-3416-43d9-8604-8b93f1b448e6 req-93d35614-27e3-4c21-b979-395ed4b3431c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 Jul 21 06:31:25.060423 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 103/198] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:31:25.304597 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5d5dd784-3082-469b-b50e-317a63465775 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:25.305382 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5d5dd784-3082-469b-b50e-317a63465775 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:25.311925 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5d5dd784-3082-469b-b50e-317a63465775 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:25.312376 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5d5dd784-3082-469b-b50e-317a63465775 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:25.313150 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5d5dd784-3082-469b-b50e-317a63465775 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:25.313584 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5d5dd784-3082-469b-b50e-317a63465775 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:25.450221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5d5dd784-3082-469b-b50e-317a63465775 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:25.457593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5d5dd784-3082-469b-b50e-317a63465775 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.158073 Jul 21 06:31:25.458192 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 104/199] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:25 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:25.577890 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bc9212ca-68dc-4790-a905-59aae2eb5663 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:25.578568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bc9212ca-68dc-4790-a905-59aae2eb5663 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:25.585333 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc9212ca-68dc-4790-a905-59aae2eb5663 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:25.585785 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc9212ca-68dc-4790-a905-59aae2eb5663 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:25.586596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc9212ca-68dc-4790-a905-59aae2eb5663 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:25.587041 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc9212ca-68dc-4790-a905-59aae2eb5663 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:25.742307 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bc9212ca-68dc-4790-a905-59aae2eb5663 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:25.758220 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bc9212ca-68dc-4790-a905-59aae2eb5663 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.185102 Jul 21 06:31:25.758951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 105/200] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:25 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:25.763802 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3204b4df-b01f-45a3-a01d-3a3464b61d02 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:25.764403 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3204b4df-b01f-45a3-a01d-3a3464b61d02 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:25.776422 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3204b4df-b01f-45a3-a01d-3a3464b61d02 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:25.777176 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3204b4df-b01f-45a3-a01d-3a3464b61d02 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:25.778447 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3204b4df-b01f-45a3-a01d-3a3464b61d02 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:25.778948 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3204b4df-b01f-45a3-a01d-3a3464b61d02 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:25.879066 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3204b4df-b01f-45a3-a01d-3a3464b61d02 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:25.887497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3204b4df-b01f-45a3-a01d-3a3464b61d02 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1273 microversion: 2.1 time: 0.127042 Jul 21 06:31:25.887942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 106/201] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:25 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:25.918697 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-514a71ec-2faa-493a-908b-7c9985737068 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:25.919326 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-514a71ec-2faa-493a-908b-7c9985737068 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:25.928613 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-514a71ec-2faa-493a-908b-7c9985737068 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:25.928613 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-514a71ec-2faa-493a-908b-7c9985737068 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:25.928613 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-514a71ec-2faa-493a-908b-7c9985737068 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:25.928613 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-514a71ec-2faa-493a-908b-7c9985737068 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:26.099381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-514a71ec-2faa-493a-908b-7c9985737068 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:26.108738 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-514a71ec-2faa-493a-908b-7c9985737068 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.193944 Jul 21 06:31:26.120354 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 107/202] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:25 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:26.474719 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3b705e9f-0b07-4503-8edd-291524138611 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:26.476060 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3b705e9f-0b07-4503-8edd-291524138611 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:26.478133 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:26.483241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3b705e9f-0b07-4503-8edd-291524138611 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:26.483685 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3b705e9f-0b07-4503-8edd-291524138611 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:26.484445 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3b705e9f-0b07-4503-8edd-291524138611 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:26.484873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3b705e9f-0b07-4503-8edd-291524138611 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:26.628232 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3b705e9f-0b07-4503-8edd-291524138611 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:26.637453 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3b705e9f-0b07-4503-8edd-291524138611 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.166422 Jul 21 06:31:26.638843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 108/203] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:26 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:26.775171 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-49ddf05c-acc7-4561-9712-837515b3ed71 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:26.776053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-49ddf05c-acc7-4561-9712-837515b3ed71 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:26.782931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49ddf05c-acc7-4561-9712-837515b3ed71 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:26.783385 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49ddf05c-acc7-4561-9712-837515b3ed71 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:26.784173 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49ddf05c-acc7-4561-9712-837515b3ed71 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:26.784612 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49ddf05c-acc7-4561-9712-837515b3ed71 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:27.046655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fd546ec8-cea1-4623-aae3-1bf3a8a35542 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "POST /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.151966 Jul 21 06:31:27.056796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 96/204] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:31:22 2022] POST /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7/os-volume_attachments => generated 194 bytes in 4154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:31:27.061122 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-96e3d470-4b99-4c48-8326-6a3848c4051a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:27.061910 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-96e3d470-4b99-4c48-8326-6a3848c4051a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:27.070394 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96e3d470-4b99-4c48-8326-6a3848c4051a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:27.071158 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96e3d470-4b99-4c48-8326-6a3848c4051a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:27.072307 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96e3d470-4b99-4c48-8326-6a3848c4051a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:27.079181 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96e3d470-4b99-4c48-8326-6a3848c4051a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:27.157974 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-49ddf05c-acc7-4561-9712-837515b3ed71 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:27.169993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-49ddf05c-acc7-4561-9712-837515b3ed71 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1362 microversion: 2.1 time: 0.398655 Jul 21 06:31:27.174416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 109/205] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:26 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:27.186374 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-63d42ea5-42fc-4f53-9989-e12567389af2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:27.187000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-63d42ea5-42fc-4f53-9989-e12567389af2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:27.200762 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-63d42ea5-42fc-4f53-9989-e12567389af2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:27.201458 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-63d42ea5-42fc-4f53-9989-e12567389af2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:27.202267 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-63d42ea5-42fc-4f53-9989-e12567389af2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:27.203192 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-63d42ea5-42fc-4f53-9989-e12567389af2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:27.234709 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-96e3d470-4b99-4c48-8326-6a3848c4051a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:27.244762 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-96e3d470-4b99-4c48-8326-6a3848c4051a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1271 microversion: 2.1 time: 0.191672 Jul 21 06:31:27.245339 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 97/206] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:27 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:27.356453 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-63d42ea5-42fc-4f53-9989-e12567389af2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:27.364731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-63d42ea5-42fc-4f53-9989-e12567389af2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.188961 Jul 21 06:31:27.365400 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 110/207] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:27 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:27.657966 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-103da149-dc8a-4dd9-bd16-bbff4601d53b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:27.658564 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-103da149-dc8a-4dd9-bd16-bbff4601d53b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:27.666231 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-103da149-dc8a-4dd9-bd16-bbff4601d53b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:27.666839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-103da149-dc8a-4dd9-bd16-bbff4601d53b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:27.667974 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-103da149-dc8a-4dd9-bd16-bbff4601d53b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:27.668556 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-103da149-dc8a-4dd9-bd16-bbff4601d53b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:27.802574 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-103da149-dc8a-4dd9-bd16-bbff4601d53b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:27.806597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:27.811580 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-103da149-dc8a-4dd9-bd16-bbff4601d53b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.158558 Jul 21 06:31:27.812140 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 98/208] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:27 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:28.192388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f57a5bbf-9511-473a-909a-e907fa322338 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:28.193227 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f57a5bbf-9511-473a-909a-e907fa322338 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:28.203992 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f57a5bbf-9511-473a-909a-e907fa322338 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:28.204951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f57a5bbf-9511-473a-909a-e907fa322338 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:28.205728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f57a5bbf-9511-473a-909a-e907fa322338 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:28.206183 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f57a5bbf-9511-473a-909a-e907fa322338 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:28.261517 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a3411468-7413-42ec-9f3b-93131a5d038a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:28.262807 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a3411468-7413-42ec-9f3b-93131a5d038a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:28.272032 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a3411468-7413-42ec-9f3b-93131a5d038a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:28.273320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a3411468-7413-42ec-9f3b-93131a5d038a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:28.274408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a3411468-7413-42ec-9f3b-93131a5d038a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:28.274838 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a3411468-7413-42ec-9f3b-93131a5d038a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:28.396286 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a3411468-7413-42ec-9f3b-93131a5d038a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:28.408820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a3411468-7413-42ec-9f3b-93131a5d038a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1271 microversion: 2.1 time: 0.150639 Jul 21 06:31:28.420173 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 99/209] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:28 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:28.425781 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-71d1c618-6042-47d0-baf6-2a55d2687c23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:28.426439 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-71d1c618-6042-47d0-baf6-2a55d2687c23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:28.433271 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-71d1c618-6042-47d0-baf6-2a55d2687c23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:28.433781 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-71d1c618-6042-47d0-baf6-2a55d2687c23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:28.434657 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-71d1c618-6042-47d0-baf6-2a55d2687c23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:28.435196 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-71d1c618-6042-47d0-baf6-2a55d2687c23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:28.465758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f57a5bbf-9511-473a-909a-e907fa322338 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:28.473660 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f57a5bbf-9511-473a-909a-e907fa322338 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1548 microversion: 2.1 time: 0.285891 Jul 21 06:31:28.474272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 111/210] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:28 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1548 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:28.502248 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-81d5e170-707a-4c6a-a9b8-01dfb164e154 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:28.503116 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-81d5e170-707a-4c6a-a9b8-01dfb164e154 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:28.513991 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-81d5e170-707a-4c6a-a9b8-01dfb164e154 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:28.514448 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-81d5e170-707a-4c6a-a9b8-01dfb164e154 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:28.515317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-81d5e170-707a-4c6a-a9b8-01dfb164e154 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:28.515668 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-81d5e170-707a-4c6a-a9b8-01dfb164e154 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:28.656203 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-71d1c618-6042-47d0-baf6-2a55d2687c23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:28.664777 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-71d1c618-6042-47d0-baf6-2a55d2687c23 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1367 microversion: 2.1 time: 0.242712 Jul 21 06:31:28.665408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 100/211] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:28 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:28.676007 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-81d5e170-707a-4c6a-a9b8-01dfb164e154 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187617 Jul 21 06:31:28.676627 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 112/212] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 06:31:28 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:31:28.829136 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9a39f7ea-d4f9-449b-a854-14f29a15dce8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:28.830112 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9a39f7ea-d4f9-449b-a854-14f29a15dce8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:28.839170 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a39f7ea-d4f9-449b-a854-14f29a15dce8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:28.845502 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a39f7ea-d4f9-449b-a854-14f29a15dce8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:28.846451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a39f7ea-d4f9-449b-a854-14f29a15dce8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:28.846896 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a39f7ea-d4f9-449b-a854-14f29a15dce8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:29.340175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9a39f7ea-d4f9-449b-a854-14f29a15dce8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:29.349177 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9a39f7ea-d4f9-449b-a854-14f29a15dce8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.524432 Jul 21 06:31:29.361369 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 101/213] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:28 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:29.431739 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7f8df243-e03b-4d8c-be67-a6900905013e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:29.432889 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7f8df243-e03b-4d8c-be67-a6900905013e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:29.443850 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f8df243-e03b-4d8c-be67-a6900905013e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:29.445198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f8df243-e03b-4d8c-be67-a6900905013e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:29.447199 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f8df243-e03b-4d8c-be67-a6900905013e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:29.447668 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f8df243-e03b-4d8c-be67-a6900905013e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:29.682781 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9fb3422f-a304-4fd8-b0b0-d240f57e2420 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:29.683656 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9fb3422f-a304-4fd8-b0b0-d240f57e2420 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:29.690288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9fb3422f-a304-4fd8-b0b0-d240f57e2420 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:29.690937 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9fb3422f-a304-4fd8-b0b0-d240f57e2420 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:29.691884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9fb3422f-a304-4fd8-b0b0-d240f57e2420 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:29.692464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9fb3422f-a304-4fd8-b0b0-d240f57e2420 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:29.730349 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7f8df243-e03b-4d8c-be67-a6900905013e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:29.748857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7f8df243-e03b-4d8c-be67-a6900905013e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.324826 Jul 21 06:31:29.749614 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 113/214] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:29 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:29.940897 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9fb3422f-a304-4fd8-b0b0-d240f57e2420 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:29.954121 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9fb3422f-a304-4fd8-b0b0-d240f57e2420 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1557 microversion: 2.1 time: 0.276245 Jul 21 06:31:29.954953 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 102/215] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:29 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1557 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:29.979949 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-53efaea9-743d-4b52-81d2-4dbcea9720f7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:29.981262 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-53efaea9-743d-4b52-81d2-4dbcea9720f7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:30.000213 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-53efaea9-743d-4b52-81d2-4dbcea9720f7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:30.000862 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-53efaea9-743d-4b52-81d2-4dbcea9720f7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:30.003202 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-53efaea9-743d-4b52-81d2-4dbcea9720f7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:30.004096 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-53efaea9-743d-4b52-81d2-4dbcea9720f7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:30.026020 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-ecc5f8d5-70b1-4303-91ee-39ff2abcec44 req-2572e01c-a420-4748-9ccc-5616f61d6ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9fc922-6315-4ec5-adda-8d3b6c1b3730", "tag": "700b0f4d-346e-4b49-b171-537c02f06a17"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:30.043832 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-ecc5f8d5-70b1-4303-91ee-39ff2abcec44 req-2572e01c-a420-4748-9ccc-5616f61d6ffa service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:30.044287 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-ecc5f8d5-70b1-4303-91ee-39ff2abcec44 req-2572e01c-a420-4748-9ccc-5616f61d6ffa service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:30.065337 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-ecc5f8d5-70b1-4303-91ee-39ff2abcec44 req-2572e01c-a420-4748-9ccc-5616f61d6ffa service nova] Creating event network-changed:700b0f4d-346e-4b49-b171-537c02f06a17 for instance 1f9fc922-6315-4ec5-adda-8d3b6c1b3730 on hv-cinder-85031 Jul 21 06:31:30.073240 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-ecc5f8d5-70b1-4303-91ee-39ff2abcec44 req-2572e01c-a420-4748-9ccc-5616f61d6ffa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051197 Jul 21 06:31:30.075109 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 103/216] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:31:30.150810 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-53efaea9-743d-4b52-81d2-4dbcea9720f7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183044 Jul 21 06:31:30.151926 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 114/217] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 06:31:29 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:30.370630 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9d34ed37-0d21-493b-9422-b4d2861ee0b5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:30.371739 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9d34ed37-0d21-493b-9422-b4d2861ee0b5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:30.382328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9d34ed37-0d21-493b-9422-b4d2861ee0b5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:30.383042 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9d34ed37-0d21-493b-9422-b4d2861ee0b5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:30.384005 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9d34ed37-0d21-493b-9422-b4d2861ee0b5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:30.384616 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9d34ed37-0d21-493b-9422-b4d2861ee0b5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:30.767989 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a8495d0f-573d-42a7-86a8-6cd11ae4f3c1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:30.768803 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a8495d0f-573d-42a7-86a8-6cd11ae4f3c1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:30.775889 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a8495d0f-573d-42a7-86a8-6cd11ae4f3c1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:30.776708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a8495d0f-573d-42a7-86a8-6cd11ae4f3c1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:30.777493 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a8495d0f-573d-42a7-86a8-6cd11ae4f3c1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:30.777928 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a8495d0f-573d-42a7-86a8-6cd11ae4f3c1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:31.190506 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9d34ed37-0d21-493b-9422-b4d2861ee0b5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:31.198021 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9d34ed37-0d21-493b-9422-b4d2861ee0b5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.834203 Jul 21 06:31:31.198756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 104/218] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:30 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:31.290597 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a8495d0f-573d-42a7-86a8-6cd11ae4f3c1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:31.294031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:31.304365 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a8495d0f-573d-42a7-86a8-6cd11ae4f3c1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.539216 Jul 21 06:31:31.305607 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 115/219] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:30 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:31.409037 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-1872f8c6-c798-4b1e-bde4-6bc434f5760f req-f57b40de-208d-4fd6-b1d3-e9127ae69329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7788e87-32b8-4250-bae6-b666d958ab97", "tag": "64c03855-c1db-478e-916b-e86e4f9e9bdc"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:31.428247 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-1872f8c6-c798-4b1e-bde4-6bc434f5760f req-f57b40de-208d-4fd6-b1d3-e9127ae69329 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:31.430372 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-1872f8c6-c798-4b1e-bde4-6bc434f5760f req-f57b40de-208d-4fd6-b1d3-e9127ae69329 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:31.447940 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-1872f8c6-c798-4b1e-bde4-6bc434f5760f req-f57b40de-208d-4fd6-b1d3-e9127ae69329 service nova] Creating event network-changed:64c03855-c1db-478e-916b-e86e4f9e9bdc for instance e7788e87-32b8-4250-bae6-b666d958ab97 on hv-cinder-85031 Jul 21 06:31:31.464002 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-1872f8c6-c798-4b1e-bde4-6bc434f5760f req-f57b40de-208d-4fd6-b1d3-e9127ae69329 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059619 Jul 21 06:31:31.465007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 105/220] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:32.218830 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a22d14f1-8b05-4400-9b72-0bb040e17550 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:32.220520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a22d14f1-8b05-4400-9b72-0bb040e17550 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:32.228472 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a22d14f1-8b05-4400-9b72-0bb040e17550 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:32.229226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a22d14f1-8b05-4400-9b72-0bb040e17550 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:32.230680 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a22d14f1-8b05-4400-9b72-0bb040e17550 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:32.232896 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a22d14f1-8b05-4400-9b72-0bb040e17550 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:32.328719 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-54775257-3634-4584-92b2-6e5957381fed tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:32.329448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-54775257-3634-4584-92b2-6e5957381fed tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:32.349465 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-54775257-3634-4584-92b2-6e5957381fed tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:32.350586 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-54775257-3634-4584-92b2-6e5957381fed tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:32.352683 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-54775257-3634-4584-92b2-6e5957381fed tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:32.353796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-54775257-3634-4584-92b2-6e5957381fed tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:32.931496 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-54775257-3634-4584-92b2-6e5957381fed tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:32.946671 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-54775257-3634-4584-92b2-6e5957381fed tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.627666 Jul 21 06:31:32.948270 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 106/221] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:32 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:32.960578 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e463ad3d-28bc-47f5-8752-8a141b462800 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:32.961496 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e463ad3d-28bc-47f5-8752-8a141b462800 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:32.976618 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e463ad3d-28bc-47f5-8752-8a141b462800 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:32.984259 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e463ad3d-28bc-47f5-8752-8a141b462800 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:32.986642 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e463ad3d-28bc-47f5-8752-8a141b462800 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:32.987424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e463ad3d-28bc-47f5-8752-8a141b462800 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:33.045694 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e463ad3d-28bc-47f5-8752-8a141b462800 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:31:33.191962 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e463ad3d-28bc-47f5-8752-8a141b462800 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 204 len: 0 microversion: 2.1 time: 0.234794 Jul 21 06:31:33.192941 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 107/222] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:31:32 2022] DELETE /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:31:33.205327 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5f955974-9107-456d-97e3-0b8c01c108a4 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:33.206433 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5f955974-9107-456d-97e3-0b8c01c108a4 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:33.218023 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f955974-9107-456d-97e3-0b8c01c108a4 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:33.218636 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f955974-9107-456d-97e3-0b8c01c108a4 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:33.219631 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f955974-9107-456d-97e3-0b8c01c108a4 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:33.220407 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f955974-9107-456d-97e3-0b8c01c108a4 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:33.531809 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a22d14f1-8b05-4400-9b72-0bb040e17550 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:33.543532 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a22d14f1-8b05-4400-9b72-0bb040e17550 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 1.332522 Jul 21 06:31:33.554750 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 116/223] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:32 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:33.559850 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-ec2e380d-6946-4a77-964d-f2d7ed1e632a req-bfd71043-13f4-4dda-b501-e90d5b78e2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f81355-5e49-4559-b29c-b6faefe880b7", "tag": "0004c418-8336-40b0-9995-58b47e33de84"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:33.569653 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-ec2e380d-6946-4a77-964d-f2d7ed1e632a req-bfd71043-13f4-4dda-b501-e90d5b78e2ff service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:33.570593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-ec2e380d-6946-4a77-964d-f2d7ed1e632a req-bfd71043-13f4-4dda-b501-e90d5b78e2ff service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:33.583999 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-ec2e380d-6946-4a77-964d-f2d7ed1e632a req-bfd71043-13f4-4dda-b501-e90d5b78e2ff service nova] Creating event network-changed:0004c418-8336-40b0-9995-58b47e33de84 for instance 43f81355-5e49-4559-b29c-b6faefe880b7 on hv-cinder-85031 Jul 21 06:31:33.584897 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5f955974-9107-456d-97e3-0b8c01c108a4 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:33.589993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-ec2e380d-6946-4a77-964d-f2d7ed1e632a req-bfd71043-13f4-4dda-b501-e90d5b78e2ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033657 Jul 21 06:31:33.591481 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 117/224] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:33.593191 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5f955974-9107-456d-97e3-0b8c01c108a4 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1553 microversion: 2.1 time: 0.394689 Jul 21 06:31:33.594353 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 108/225] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:33 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1553 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:33.968657 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-96d72b26-e239-4b75-906d-e5026b640918 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:33.969372 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-96d72b26-e239-4b75-906d-e5026b640918 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:33.979770 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-96d72b26-e239-4b75-906d-e5026b640918 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:33.980417 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-96d72b26-e239-4b75-906d-e5026b640918 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:33.981370 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-96d72b26-e239-4b75-906d-e5026b640918 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:33.981989 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-96d72b26-e239-4b75-906d-e5026b640918 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:34.131914 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-96d72b26-e239-4b75-906d-e5026b640918 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:34.141438 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-96d72b26-e239-4b75-906d-e5026b640918 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.179397 Jul 21 06:31:34.142793 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 118/226] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:33 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:34.561814 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-039f5484-059a-4efa-83b3-10ee7a74411a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:34.562519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-039f5484-059a-4efa-83b3-10ee7a74411a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:34.571193 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-039f5484-059a-4efa-83b3-10ee7a74411a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:34.571645 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-039f5484-059a-4efa-83b3-10ee7a74411a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:34.572428 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-039f5484-059a-4efa-83b3-10ee7a74411a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:34.572870 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-039f5484-059a-4efa-83b3-10ee7a74411a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:34.612411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dc7a49bb-f0db-4729-8937-e5361c5a975c tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:34.612979 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dc7a49bb-f0db-4729-8937-e5361c5a975c tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:34.620159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dc7a49bb-f0db-4729-8937-e5361c5a975c tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:34.620603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dc7a49bb-f0db-4729-8937-e5361c5a975c tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:34.621368 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dc7a49bb-f0db-4729-8937-e5361c5a975c tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:34.621794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dc7a49bb-f0db-4729-8937-e5361c5a975c tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:34.757095 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-039f5484-059a-4efa-83b3-10ee7a74411a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:34.764807 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-039f5484-059a-4efa-83b3-10ee7a74411a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.206876 Jul 21 06:31:34.765389 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 109/227] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:34 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:34.786797 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dc7a49bb-f0db-4729-8937-e5361c5a975c tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:34.794566 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dc7a49bb-f0db-4729-8937-e5361c5a975c tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1553 microversion: 2.1 time: 0.186219 Jul 21 06:31:34.795126 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 119/228] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:34 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:35.159680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c90b4064-4a76-40b3-80ca-81158f04adbd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:35.160296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c90b4064-4a76-40b3-80ca-81158f04adbd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:35.166989 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c90b4064-4a76-40b3-80ca-81158f04adbd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:35.167448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c90b4064-4a76-40b3-80ca-81158f04adbd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:35.168215 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c90b4064-4a76-40b3-80ca-81158f04adbd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:35.168655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c90b4064-4a76-40b3-80ca-81158f04adbd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:35.299921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c90b4064-4a76-40b3-80ca-81158f04adbd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:35.308696 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c90b4064-4a76-40b3-80ca-81158f04adbd tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.152870 Jul 21 06:31:35.309491 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 110/229] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:35 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:35.783015 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a4c8a347-c0bc-4aeb-a376-e7608a72b012 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:35.783621 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a4c8a347-c0bc-4aeb-a376-e7608a72b012 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:35.790892 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a4c8a347-c0bc-4aeb-a376-e7608a72b012 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:35.791368 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a4c8a347-c0bc-4aeb-a376-e7608a72b012 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:35.792088 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a4c8a347-c0bc-4aeb-a376-e7608a72b012 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:35.792534 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a4c8a347-c0bc-4aeb-a376-e7608a72b012 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:35.812328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-722b6ece-8d45-4d92-8c81-4e8e7b0d9ba0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:35.813732 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-722b6ece-8d45-4d92-8c81-4e8e7b0d9ba0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:35.821659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-722b6ece-8d45-4d92-8c81-4e8e7b0d9ba0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:35.822345 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-722b6ece-8d45-4d92-8c81-4e8e7b0d9ba0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:35.823302 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-722b6ece-8d45-4d92-8c81-4e8e7b0d9ba0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:35.823918 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-722b6ece-8d45-4d92-8c81-4e8e7b0d9ba0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:36.073827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a4c8a347-c0bc-4aeb-a376-e7608a72b012 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:36.091581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a4c8a347-c0bc-4aeb-a376-e7608a72b012 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.312170 Jul 21 06:31:36.092533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 120/230] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:35 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:36.121985 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-722b6ece-8d45-4d92-8c81-4e8e7b0d9ba0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:36.130265 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-722b6ece-8d45-4d92-8c81-4e8e7b0d9ba0 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1553 microversion: 2.1 time: 0.322603 Jul 21 06:31:36.131867 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 111/231] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:35 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1553 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:36.325431 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-067e9fb7-e553-4939-9c7e-bfc5478e99f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:36.325980 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-067e9fb7-e553-4939-9c7e-bfc5478e99f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:36.332641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-067e9fb7-e553-4939-9c7e-bfc5478e99f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:36.333317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-067e9fb7-e553-4939-9c7e-bfc5478e99f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:36.335252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-067e9fb7-e553-4939-9c7e-bfc5478e99f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:36.335704 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-067e9fb7-e553-4939-9c7e-bfc5478e99f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:36.469961 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-067e9fb7-e553-4939-9c7e-bfc5478e99f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:36.478392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-067e9fb7-e553-4939-9c7e-bfc5478e99f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.156971 Jul 21 06:31:36.478933 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 121/232] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:36 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:37.112808 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-dc3b23d5-14d1-4e22-9a35-ea4cf7ffb107 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:37.114221 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-dc3b23d5-14d1-4e22-9a35-ea4cf7ffb107 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:37.123239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dc3b23d5-14d1-4e22-9a35-ea4cf7ffb107 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:37.123619 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dc3b23d5-14d1-4e22-9a35-ea4cf7ffb107 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:37.124399 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dc3b23d5-14d1-4e22-9a35-ea4cf7ffb107 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:37.124834 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dc3b23d5-14d1-4e22-9a35-ea4cf7ffb107 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:37.147939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2d612a67-66e2-4ce9-abc7-dd25f8e35786 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:37.148544 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2d612a67-66e2-4ce9-abc7-dd25f8e35786 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:37.155195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2d612a67-66e2-4ce9-abc7-dd25f8e35786 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:37.155824 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2d612a67-66e2-4ce9-abc7-dd25f8e35786 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:37.156586 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2d612a67-66e2-4ce9-abc7-dd25f8e35786 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:37.157014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2d612a67-66e2-4ce9-abc7-dd25f8e35786 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:37.339448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-dc3b23d5-14d1-4e22-9a35-ea4cf7ffb107 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:37.343347 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2d612a67-66e2-4ce9-abc7-dd25f8e35786 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:37.345688 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-dc3b23d5-14d1-4e22-9a35-ea4cf7ffb107 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.238814 Jul 21 06:31:37.346321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 112/233] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:37 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:37.353251 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2d612a67-66e2-4ce9-abc7-dd25f8e35786 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1553 microversion: 2.1 time: 0.209681 Jul 21 06:31:37.353904 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 122/234] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:37 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:37.494672 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f8fd54c8-2c9e-460a-834c-a8f74c78c31a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:37.495290 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f8fd54c8-2c9e-460a-834c-a8f74c78c31a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:37.501646 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f8fd54c8-2c9e-460a-834c-a8f74c78c31a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:37.502134 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f8fd54c8-2c9e-460a-834c-a8f74c78c31a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:37.503117 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f8fd54c8-2c9e-460a-834c-a8f74c78c31a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:37.503448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f8fd54c8-2c9e-460a-834c-a8f74c78c31a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:37.689529 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f8fd54c8-2c9e-460a-834c-a8f74c78c31a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:37.698447 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f8fd54c8-2c9e-460a-834c-a8f74c78c31a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.207837 Jul 21 06:31:37.699236 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 113/235] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:37 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:38.363988 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-577a878a-4298-4fd6-b77b-f6950bc9586b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:38.364756 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-577a878a-4298-4fd6-b77b-f6950bc9586b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:38.370294 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f0dde1d2-6c39-4017-ab44-6e68cdd7f0a6 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:38.371489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f0dde1d2-6c39-4017-ab44-6e68cdd7f0a6 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:38.371928 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-577a878a-4298-4fd6-b77b-f6950bc9586b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:38.372647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-577a878a-4298-4fd6-b77b-f6950bc9586b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:38.373485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-577a878a-4298-4fd6-b77b-f6950bc9586b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:38.374177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-577a878a-4298-4fd6-b77b-f6950bc9586b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:38.378329 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f0dde1d2-6c39-4017-ab44-6e68cdd7f0a6 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:38.378779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f0dde1d2-6c39-4017-ab44-6e68cdd7f0a6 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:38.379558 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f0dde1d2-6c39-4017-ab44-6e68cdd7f0a6 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:38.379995 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f0dde1d2-6c39-4017-ab44-6e68cdd7f0a6 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:38.588942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-577a878a-4298-4fd6-b77b-f6950bc9586b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:38.590471 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f0dde1d2-6c39-4017-ab44-6e68cdd7f0a6 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:38.599155 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-577a878a-4298-4fd6-b77b-f6950bc9586b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.238970 Jul 21 06:31:38.599645 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f0dde1d2-6c39-4017-ab44-6e68cdd7f0a6 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1553 microversion: 2.1 time: 0.233210 Jul 21 06:31:38.601889 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 114/236] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:38 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:38.603647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 123/237] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:38 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:38.716542 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ed515513-8baa-46b5-81c7-f2544196bada tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:38.717262 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ed515513-8baa-46b5-81c7-f2544196bada tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:38.723350 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed515513-8baa-46b5-81c7-f2544196bada tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:38.723794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed515513-8baa-46b5-81c7-f2544196bada tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:38.724560 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed515513-8baa-46b5-81c7-f2544196bada tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:38.725529 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed515513-8baa-46b5-81c7-f2544196bada tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:38.732289 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:38.917120 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-0dd5e5de-d852-4ca3-a87c-28a84b027d0c req-ea37e277-3927-43e5-9942-5a95471b0117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7", "name": "network-vif-deleted", "tag": "5b1a0fbc-da41-4a91-9ccb-b82810ccd7ef"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:38.922215 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ed515513-8baa-46b5-81c7-f2544196bada tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:38.930052 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-0dd5e5de-d852-4ca3-a87c-28a84b027d0c req-ea37e277-3927-43e5-9942-5a95471b0117 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:38.930753 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-0dd5e5de-d852-4ca3-a87c-28a84b027d0c req-ea37e277-3927-43e5-9942-5a95471b0117 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:38.932240 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ed515513-8baa-46b5-81c7-f2544196bada tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.219852 Jul 21 06:31:38.942388 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 115/238] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:38 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:38.956285 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-0dd5e5de-d852-4ca3-a87c-28a84b027d0c req-ea37e277-3927-43e5-9942-5a95471b0117 service nova] Creating event network-vif-deleted:5b1a0fbc-da41-4a91-9ccb-b82810ccd7ef for instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 on hv-cinder-85031 Jul 21 06:31:38.964224 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-0dd5e5de-d852-4ca3-a87c-28a84b027d0c req-ea37e277-3927-43e5-9942-5a95471b0117 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054588 Jul 21 06:31:38.964842 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 124/239] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:31:39.618397 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:39.621273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d6668b45-c2ad-489b-8912-1f29fb9d5b7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:39.622021 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d6668b45-c2ad-489b-8912-1f29fb9d5b7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:39.622837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:39.629794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d6668b45-c2ad-489b-8912-1f29fb9d5b7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:39.630273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d6668b45-c2ad-489b-8912-1f29fb9d5b7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:39.631132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d6668b45-c2ad-489b-8912-1f29fb9d5b7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:39.632199 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d6668b45-c2ad-489b-8912-1f29fb9d5b7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:39.633219 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:39.634129 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:39.635455 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:39.636074 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:39.684116 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:39.684568 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:39.685035 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lazy-loading 'fault' on Instance uuid db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:31:39.745051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfeb642f25484665b7c477cde153162d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c743e22f3fdb4a61ad1b8035ac06d15b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:39.755908 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2b0ac574-6b23-488e-9ab9-b962c55a3d46 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 200 len: 1350 microversion: 2.1 time: 0.142614 Jul 21 06:31:39.757270 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 116/240] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:39 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:39.808590 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d6668b45-c2ad-489b-8912-1f29fb9d5b7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:39.816011 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d6668b45-c2ad-489b-8912-1f29fb9d5b7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.200691 Jul 21 06:31:39.816586 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 125/241] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:39 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:39.949807 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e62bc172-be6c-4ccc-9d78-dfcd3976745e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:39.950685 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e62bc172-be6c-4ccc-9d78-dfcd3976745e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:39.957483 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e62bc172-be6c-4ccc-9d78-dfcd3976745e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:39.957960 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e62bc172-be6c-4ccc-9d78-dfcd3976745e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:39.958816 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e62bc172-be6c-4ccc-9d78-dfcd3976745e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:39.960267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e62bc172-be6c-4ccc-9d78-dfcd3976745e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:40.117687 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e62bc172-be6c-4ccc-9d78-dfcd3976745e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:40.130392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e62bc172-be6c-4ccc-9d78-dfcd3976745e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.184420 Jul 21 06:31:40.131215 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 117/242] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:39 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:40.773338 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0437ce9d-2830-4e4b-86a8-5a715386ee59 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:40.774034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0437ce9d-2830-4e4b-86a8-5a715386ee59 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:40.780873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0437ce9d-2830-4e4b-86a8-5a715386ee59 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:40.781329 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0437ce9d-2830-4e4b-86a8-5a715386ee59 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:40.782166 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0437ce9d-2830-4e4b-86a8-5a715386ee59 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:40.782670 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0437ce9d-2830-4e4b-86a8-5a715386ee59 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:40.796854 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-0437ce9d-2830-4e4b-86a8-5a715386ee59 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] HTTP exception thrown: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0437ce9d-2830-4e4b-86a8-5a715386ee59 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Request method failure captured: Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 HTTP/1.1 Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKHZE7XSLA3ocSIAUOY7r9a6EdPZ__GMhl4tAxLaolDd472FL2xxtR6-S3vsVkPHbN-lIazQWT1yD2oB8zvDUWhJXqwZjunVnLLgIptdijwjr2o4gZ85gsWJmTg3jNmso7zT5stS0NYGgbF8RhJ74Cmv6cAkm3qa3Ygllg94tn21u4 Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: c743e22f3fdb4a61ad1b8035ac06d15b Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:31:40.801848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c743e22f3fdb4a61ad1b8035ac06d15b"}]}] Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: c743e22f3fdb4a61ad1b8035ac06d15b Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-DeleteServersTestJSON-1844715052-project Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: dfeb642f25484665b7c477cde153162d Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-DeleteServersTestJSON-1844715052-project Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:40.804106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7'} Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:31:40.804939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:40.806351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:40.808249 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0437ce9d-2830-4e4b-86a8-5a715386ee59 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Returning 404 to user: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:31:40.808249 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0437ce9d-2830-4e4b-86a8-5a715386ee59 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 404 len: 111 microversion: 2.1 time: 0.033986 Jul 21 06:31:40.808249 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 126/243] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:40 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:31:40.834016 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7b927148-6615-433b-bd41-75f3e38e97ab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:40.834885 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7b927148-6615-433b-bd41-75f3e38e97ab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:40.842583 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7b927148-6615-433b-bd41-75f3e38e97ab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:40.843043 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7b927148-6615-433b-bd41-75f3e38e97ab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:40.844079 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7b927148-6615-433b-bd41-75f3e38e97ab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:40.844634 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7b927148-6615-433b-bd41-75f3e38e97ab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:40.932094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1471cea1-4083-46cd-a7ab-bbf7967e7b01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:40.933076 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1471cea1-4083-46cd-a7ab-bbf7967e7b01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:40.940234 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1471cea1-4083-46cd-a7ab-bbf7967e7b01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:40.940533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1471cea1-4083-46cd-a7ab-bbf7967e7b01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:40.941306 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1471cea1-4083-46cd-a7ab-bbf7967e7b01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:40.941744 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1471cea1-4083-46cd-a7ab-bbf7967e7b01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:40.955594 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-1471cea1-4083-46cd-a7ab-bbf7967e7b01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] HTTP exception thrown: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1471cea1-4083-46cd-a7ab-bbf7967e7b01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Request method failure captured: Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7/os-volume_attachments HTTP/1.1 Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKHZE7XSLA3ocSIAUOY7r9a6EdPZ__GMhl4tAxLaolDd472FL2xxtR6-S3vsVkPHbN-lIazQWT1yD2oB8zvDUWhJXqwZjunVnLLgIptdijwjr2o4gZ85gsWJmTg3jNmso7zT5stS0NYGgbF8RhJ74Cmv6cAkm3qa3Ygllg94tn21u4 Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: c743e22f3fdb4a61ad1b8035ac06d15b Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:31:40.957693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c743e22f3fdb4a61ad1b8035ac06d15b"}]}] Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: c743e22f3fdb4a61ad1b8035ac06d15b Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-DeleteServersTestJSON-1844715052-project Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: dfeb642f25484665b7c477cde153162d Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-DeleteServersTestJSON-1844715052-project Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:40.959336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'server_id': 'db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7'} Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:31:40.960252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:40.961317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:40.962446 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1471cea1-4083-46cd-a7ab-bbf7967e7b01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Returning 404 to user: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:31:40.962446 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1471cea1-4083-46cd-a7ab-bbf7967e7b01 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035225 Jul 21 06:31:40.962446 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 127/244] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:31:40 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:31:41.017007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7b927148-6615-433b-bd41-75f3e38e97ab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:41.026538 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7b927148-6615-433b-bd41-75f3e38e97ab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.192780 Jul 21 06:31:41.030088 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 118/245] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:40 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:41.151199 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c9a444de-d95f-4127-9240-444158aaacf0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:41.151813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c9a444de-d95f-4127-9240-444158aaacf0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:41.160669 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9a444de-d95f-4127-9240-444158aaacf0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:41.161145 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9a444de-d95f-4127-9240-444158aaacf0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:41.161898 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9a444de-d95f-4127-9240-444158aaacf0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:41.162521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9a444de-d95f-4127-9240-444158aaacf0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:41.325600 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c9a444de-d95f-4127-9240-444158aaacf0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:41.335464 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c9a444de-d95f-4127-9240-444158aaacf0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.187733 Jul 21 06:31:41.336176 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 128/246] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:41 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:42.039633 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fffa51d7-bf4b-4ef3-979b-f3073c179693 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:42.040245 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fffa51d7-bf4b-4ef3-979b-f3073c179693 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:42.047480 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fffa51d7-bf4b-4ef3-979b-f3073c179693 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:42.048172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fffa51d7-bf4b-4ef3-979b-f3073c179693 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:42.049100 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fffa51d7-bf4b-4ef3-979b-f3073c179693 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:42.049614 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fffa51d7-bf4b-4ef3-979b-f3073c179693 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:42.185063 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1fc1b278-25aa-4fed-b5a2-38976c255431 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:42.186216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1fc1b278-25aa-4fed-b5a2-38976c255431 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:42.192237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1fc1b278-25aa-4fed-b5a2-38976c255431 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:42.193047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1fc1b278-25aa-4fed-b5a2-38976c255431 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:42.194619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1fc1b278-25aa-4fed-b5a2-38976c255431 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:42.195068 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1fc1b278-25aa-4fed-b5a2-38976c255431 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:42.211071 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-1fc1b278-25aa-4fed-b5a2-38976c255431 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] HTTP exception thrown: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:42.212496 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fffa51d7-bf4b-4ef3-979b-f3073c179693 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1fc1b278-25aa-4fed-b5a2-38976c255431 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Request method failure captured: Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 HTTP/1.1 Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKHZE7XSLA3ocSIAUOY7r9a6EdPZ__GMhl4tAxLaolDd472FL2xxtR6-S3vsVkPHbN-lIazQWT1yD2oB8zvDUWhJXqwZjunVnLLgIptdijwjr2o4gZ85gsWJmTg3jNmso7zT5stS0NYGgbF8RhJ74Cmv6cAkm3qa3Ygllg94tn21u4 Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: c743e22f3fdb4a61ad1b8035ac06d15b Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:31:42.213046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c743e22f3fdb4a61ad1b8035ac06d15b"}]}] Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: c743e22f3fdb4a61ad1b8035ac06d15b Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-DeleteServersTestJSON-1844715052-project Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: dfeb642f25484665b7c477cde153162d Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-DeleteServersTestJSON-1844715052-project Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:42.214459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7'} Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:31:42.215263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:42.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:42.218696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1fc1b278-25aa-4fed-b5a2-38976c255431 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Returning 404 to user: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:31:42.219610 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1fc1b278-25aa-4fed-b5a2-38976c255431 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 404 len: 111 microversion: 2.1 time: 0.039277 Jul 21 06:31:42.220318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 129/247] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:31:42 2022] DELETE /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:31:42.223815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fffa51d7-bf4b-4ef3-979b-f3073c179693 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.188334 Jul 21 06:31:42.224395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 119/248] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:42 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:42.229184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a2e5954f-d607-41c2-a2d8-1c014d6e6d16 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:42.229804 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a2e5954f-d607-41c2-a2d8-1c014d6e6d16 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] [instance: db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:42.236482 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a2e5954f-d607-41c2-a2d8-1c014d6e6d16 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:42.236999 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a2e5954f-d607-41c2-a2d8-1c014d6e6d16 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:42.237879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a2e5954f-d607-41c2-a2d8-1c014d6e6d16 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:42.238351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a2e5954f-d607-41c2-a2d8-1c014d6e6d16 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:42.253910 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-a2e5954f-d607-41c2-a2d8-1c014d6e6d16 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] HTTP exception thrown: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a2e5954f-d607-41c2-a2d8-1c014d6e6d16 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Request method failure captured: Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 HTTP/1.1 Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKHZE7XSLA3ocSIAUOY7r9a6EdPZ__GMhl4tAxLaolDd472FL2xxtR6-S3vsVkPHbN-lIazQWT1yD2oB8zvDUWhJXqwZjunVnLLgIptdijwjr2o4gZ85gsWJmTg3jNmso7zT5stS0NYGgbF8RhJ74Cmv6cAkm3qa3Ygllg94tn21u4 Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: c743e22f3fdb4a61ad1b8035ac06d15b Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:31:42.255560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c743e22f3fdb4a61ad1b8035ac06d15b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c743e22f3fdb4a61ad1b8035ac06d15b"}]}] Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: c743e22f3fdb4a61ad1b8035ac06d15b Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-DeleteServersTestJSON-1844715052 Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-DeleteServersTestJSON-1844715052-project Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: dfeb642f25484665b7c477cde153162d Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-DeleteServersTestJSON-1844715052-project Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:42.257389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7'} Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:31:42.258132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. Jul 21 06:31:42.259179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:31:42.260167 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a2e5954f-d607-41c2-a2d8-1c014d6e6d16 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] Returning 404 to user: Instance db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:31:42.260167 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a2e5954f-d607-41c2-a2d8-1c014d6e6d16 tempest-DeleteServersTestJSON-1844715052 tempest-DeleteServersTestJSON-1844715052-project] 10.222.0.42 "GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7" status: 404 len: 111 microversion: 2.1 time: 0.032864 Jul 21 06:31:42.260167 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 130/249] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:42 2022] GET /compute/v2.1/servers/db1aa390-7c39-4dfd-8b24-c6c0cd2a92c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:31:42.353108 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-741f66bc-00f1-42d7-85e4-7be5875efb8e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:42.353721 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-741f66bc-00f1-42d7-85e4-7be5875efb8e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:42.359652 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-741f66bc-00f1-42d7-85e4-7be5875efb8e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:42.360282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-741f66bc-00f1-42d7-85e4-7be5875efb8e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:42.361045 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-741f66bc-00f1-42d7-85e4-7be5875efb8e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:42.361672 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-741f66bc-00f1-42d7-85e4-7be5875efb8e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:42.496495 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-741f66bc-00f1-42d7-85e4-7be5875efb8e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:42.504016 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-741f66bc-00f1-42d7-85e4-7be5875efb8e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.156084 Jul 21 06:31:42.504592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 120/250] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:42 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:43.242157 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9d5bc8a3-e86e-41ed-97ab-b8736409c61a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:43.244057 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9d5bc8a3-e86e-41ed-97ab-b8736409c61a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:43.251218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9d5bc8a3-e86e-41ed-97ab-b8736409c61a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:43.251673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9d5bc8a3-e86e-41ed-97ab-b8736409c61a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:43.252546 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9d5bc8a3-e86e-41ed-97ab-b8736409c61a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:43.252993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9d5bc8a3-e86e-41ed-97ab-b8736409c61a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:43.258912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-cb646f3b-1aaa-44ec-bbbf-f30e39b4d4ad req-86e0a742-6395-473b-9259-e32b45fe6899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9fc922-6315-4ec5-adda-8d3b6c1b3730", "name": "network-vif-plugged", "status": "completed", "tag": "700b0f4d-346e-4b49-b171-537c02f06a17"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:43.269880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-cb646f3b-1aaa-44ec-bbbf-f30e39b4d4ad req-86e0a742-6395-473b-9259-e32b45fe6899 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:43.270352 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-cb646f3b-1aaa-44ec-bbbf-f30e39b4d4ad req-86e0a742-6395-473b-9259-e32b45fe6899 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:43.423682 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9d5bc8a3-e86e-41ed-97ab-b8736409c61a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:43.436518 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9d5bc8a3-e86e-41ed-97ab-b8736409c61a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.199702 Jul 21 06:31:43.437328 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 131/251] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:43 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:43.455701 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-cb646f3b-1aaa-44ec-bbbf-f30e39b4d4ad req-86e0a742-6395-473b-9259-e32b45fe6899 service nova] Creating event network-vif-plugged:700b0f4d-346e-4b49-b171-537c02f06a17 for instance 1f9fc922-6315-4ec5-adda-8d3b6c1b3730 on hv-cinder-85031 Jul 21 06:31:43.462813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-cb646f3b-1aaa-44ec-bbbf-f30e39b4d4ad req-86e0a742-6395-473b-9259-e32b45fe6899 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208442 Jul 21 06:31:43.463442 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 121/252] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:31:43.524428 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-29a8844f-8fad-48d8-b950-6ca4b957d8ee tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:43.526578 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-29a8844f-8fad-48d8-b950-6ca4b957d8ee tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:43.550636 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-29a8844f-8fad-48d8-b950-6ca4b957d8ee tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:43.551099 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-29a8844f-8fad-48d8-b950-6ca4b957d8ee tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:43.551899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-29a8844f-8fad-48d8-b950-6ca4b957d8ee tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:43.553491 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-29a8844f-8fad-48d8-b950-6ca4b957d8ee tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:43.731088 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-29a8844f-8fad-48d8-b950-6ca4b957d8ee tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:43.747229 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-29a8844f-8fad-48d8-b950-6ca4b957d8ee tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.228701 Jul 21 06:31:43.747812 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 132/253] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:43 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:44.455339 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-85379820-561d-4829-b399-80ba4a506430 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:44.456623 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-85379820-561d-4829-b399-80ba4a506430 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:44.465724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-85379820-561d-4829-b399-80ba4a506430 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:44.466476 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-85379820-561d-4829-b399-80ba4a506430 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:44.467369 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-85379820-561d-4829-b399-80ba4a506430 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:44.467859 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-85379820-561d-4829-b399-80ba4a506430 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:44.690841 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-85379820-561d-4829-b399-80ba4a506430 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:44.699664 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-85379820-561d-4829-b399-80ba4a506430 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.249876 Jul 21 06:31:44.700239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 122/254] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:44 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:44.765383 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2f8df191-9881-43f2-aef9-663c4c87775b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:44.769860 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2f8df191-9881-43f2-aef9-663c4c87775b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:44.778236 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2f8df191-9881-43f2-aef9-663c4c87775b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:44.778758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2f8df191-9881-43f2-aef9-663c4c87775b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:44.779672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2f8df191-9881-43f2-aef9-663c4c87775b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:44.780114 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2f8df191-9881-43f2-aef9-663c4c87775b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:44.969780 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2f8df191-9881-43f2-aef9-663c4c87775b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:44.977347 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2f8df191-9881-43f2-aef9-663c4c87775b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1313 microversion: 2.1 time: 0.216256 Jul 21 06:31:44.977932 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 133/255] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:44 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:45.716224 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-98db4fea-0b9f-4f65-bfb5-626eed3d035d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:45.716980 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-98db4fea-0b9f-4f65-bfb5-626eed3d035d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:45.720183 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:45.727367 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-98db4fea-0b9f-4f65-bfb5-626eed3d035d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:45.728214 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-98db4fea-0b9f-4f65-bfb5-626eed3d035d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:45.729224 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-98db4fea-0b9f-4f65-bfb5-626eed3d035d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:45.729816 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-98db4fea-0b9f-4f65-bfb5-626eed3d035d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:45.917060 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-98db4fea-0b9f-4f65-bfb5-626eed3d035d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:45.926615 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-98db4fea-0b9f-4f65-bfb5-626eed3d035d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.214401 Jul 21 06:31:45.937482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 123/256] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:45 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:45.995235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ca37613d-a119-46c1-9ee8-09a7a99c4f4a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:45.996478 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ca37613d-a119-46c1-9ee8-09a7a99c4f4a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:46.004887 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca37613d-a119-46c1-9ee8-09a7a99c4f4a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:46.005695 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca37613d-a119-46c1-9ee8-09a7a99c4f4a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:46.007907 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca37613d-a119-46c1-9ee8-09a7a99c4f4a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:46.008569 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca37613d-a119-46c1-9ee8-09a7a99c4f4a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:46.186492 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ca37613d-a119-46c1-9ee8-09a7a99c4f4a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:46.195465 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ca37613d-a119-46c1-9ee8-09a7a99c4f4a tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1497 microversion: 2.1 time: 0.204985 Jul 21 06:31:46.196045 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 134/257] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:45 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:46.862366 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-003b9205-ac36-4f29-b3d6-82489fa6cdb6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:46.862888 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-003b9205-ac36-4f29-b3d6-82489fa6cdb6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:46.871997 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-003b9205-ac36-4f29-b3d6-82489fa6cdb6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:46.871997 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-003b9205-ac36-4f29-b3d6-82489fa6cdb6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:46.872710 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-003b9205-ac36-4f29-b3d6-82489fa6cdb6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:46.873239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-003b9205-ac36-4f29-b3d6-82489fa6cdb6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:46.900151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-003b9205-ac36-4f29-b3d6-82489fa6cdb6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:31:46.945125 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-df0c5f0d-2bb1-49b1-a446-3172df61df25 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:46.946333 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-df0c5f0d-2bb1-49b1-a446-3172df61df25 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:46.954610 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-df0c5f0d-2bb1-49b1-a446-3172df61df25 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:46.957055 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-df0c5f0d-2bb1-49b1-a446-3172df61df25 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:46.957929 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-df0c5f0d-2bb1-49b1-a446-3172df61df25 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:46.958463 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-df0c5f0d-2bb1-49b1-a446-3172df61df25 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:47.046075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-003b9205-ac36-4f29-b3d6-82489fa6cdb6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 204 len: 0 microversion: 2.1 time: 0.189312 Jul 21 06:31:47.058409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 124/258] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:31:46 2022] DELETE /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:31:47.072273 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9410265f-50f6-460b-a6e8-4cf1c2d771ce tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:47.072969 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9410265f-50f6-460b-a6e8-4cf1c2d771ce tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:47.079353 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9410265f-50f6-460b-a6e8-4cf1c2d771ce tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:47.079798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9410265f-50f6-460b-a6e8-4cf1c2d771ce tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:47.081361 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9410265f-50f6-460b-a6e8-4cf1c2d771ce tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:47.081809 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9410265f-50f6-460b-a6e8-4cf1c2d771ce tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:47.292000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-df0c5f0d-2bb1-49b1-a446-3172df61df25 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:47.305247 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-df0c5f0d-2bb1-49b1-a446-3172df61df25 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.363815 Jul 21 06:31:47.306582 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 135/259] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:46 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:47.369918 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9410265f-50f6-460b-a6e8-4cf1c2d771ce tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:47.388680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9410265f-50f6-460b-a6e8-4cf1c2d771ce tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1503 microversion: 2.1 time: 0.321110 Jul 21 06:31:47.389400 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 125/260] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:47 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:48.323372 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-fcbf5b69-16cc-471c-aad5-d269a6d311f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:48.324073 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-fcbf5b69-16cc-471c-aad5-d269a6d311f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:48.330567 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fcbf5b69-16cc-471c-aad5-d269a6d311f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:48.331338 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fcbf5b69-16cc-471c-aad5-d269a6d311f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:48.332103 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fcbf5b69-16cc-471c-aad5-d269a6d311f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:48.332635 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fcbf5b69-16cc-471c-aad5-d269a6d311f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:48.354830 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:48.408087 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fe0bd8bc-83ce-4ffb-ad5e-23f72c728723 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:48.408697 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fe0bd8bc-83ce-4ffb-ad5e-23f72c728723 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:48.416296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fe0bd8bc-83ce-4ffb-ad5e-23f72c728723 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:48.417001 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fe0bd8bc-83ce-4ffb-ad5e-23f72c728723 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:48.417924 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fe0bd8bc-83ce-4ffb-ad5e-23f72c728723 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:48.418538 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fe0bd8bc-83ce-4ffb-ad5e-23f72c728723 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:48.516719 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fcbf5b69-16cc-471c-aad5-d269a6d311f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:48.525354 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-fcbf5b69-16cc-471c-aad5-d269a6d311f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.206549 Jul 21 06:31:48.526467 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 136/261] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:48 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:48.590644 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fe0bd8bc-83ce-4ffb-ad5e-23f72c728723 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:48.600573 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fe0bd8bc-83ce-4ffb-ad5e-23f72c728723 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1503 microversion: 2.1 time: 0.196599 Jul 21 06:31:48.601388 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 126/262] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:48 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:49.543189 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7fb3b3a9-732c-421a-af42-29581539d747 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:49.543801 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7fb3b3a9-732c-421a-af42-29581539d747 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:49.550386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7fb3b3a9-732c-421a-af42-29581539d747 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:49.550903 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7fb3b3a9-732c-421a-af42-29581539d747 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:49.551758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7fb3b3a9-732c-421a-af42-29581539d747 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:49.552254 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7fb3b3a9-732c-421a-af42-29581539d747 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:49.620763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4198ca54-aa90-40f5-908f-a45cf99e735d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:49.625651 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4198ca54-aa90-40f5-908f-a45cf99e735d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:49.636111 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4198ca54-aa90-40f5-908f-a45cf99e735d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:49.636475 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4198ca54-aa90-40f5-908f-a45cf99e735d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:49.637490 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4198ca54-aa90-40f5-908f-a45cf99e735d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:49.638113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4198ca54-aa90-40f5-908f-a45cf99e735d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:49.739171 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4198ca54-aa90-40f5-908f-a45cf99e735d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:49.748741 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4198ca54-aa90-40f5-908f-a45cf99e735d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 200 len: 1461 microversion: 2.1 time: 0.134567 Jul 21 06:31:49.749703 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 127/263] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:49 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 1461 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:49.765860 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-f1d5c9ac-7433-4ade-9a55-e8f00950ff61 req-994af5e0-d119-4f40-b0f5-114cbbe40ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9fc922-6315-4ec5-adda-8d3b6c1b3730", "name": "network-vif-deleted", "tag": "700b0f4d-346e-4b49-b171-537c02f06a17"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:49.776384 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-f1d5c9ac-7433-4ade-9a55-e8f00950ff61 req-994af5e0-d119-4f40-b0f5-114cbbe40ddd service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:49.777057 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-f1d5c9ac-7433-4ade-9a55-e8f00950ff61 req-994af5e0-d119-4f40-b0f5-114cbbe40ddd service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:49.789336 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-f1d5c9ac-7433-4ade-9a55-e8f00950ff61 req-994af5e0-d119-4f40-b0f5-114cbbe40ddd service nova] Creating event network-vif-deleted:700b0f4d-346e-4b49-b171-537c02f06a17 for instance 1f9fc922-6315-4ec5-adda-8d3b6c1b3730 on hv-cinder-85031 Jul 21 06:31:49.795171 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-f1d5c9ac-7433-4ade-9a55-e8f00950ff61 req-994af5e0-d119-4f40-b0f5-114cbbe40ddd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033603 Jul 21 06:31:49.799146 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7fb3b3a9-732c-421a-af42-29581539d747 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:49.808555 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 128/264] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:31:49.808861 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7fb3b3a9-732c-421a-af42-29581539d747 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.268852 Jul 21 06:31:49.809724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 137/265] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:49 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:50.768123 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-426f3868-e713-45c1-a470-78755b950cae tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:50.768916 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-426f3868-e713-45c1-a470-78755b950cae tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: 1f9fc922-6315-4ec5-adda-8d3b6c1b3730] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:50.777374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-426f3868-e713-45c1-a470-78755b950cae tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:50.778436 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-426f3868-e713-45c1-a470-78755b950cae tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:50.778816 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-426f3868-e713-45c1-a470-78755b950cae tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:50.779199 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-426f3868-e713-45c1-a470-78755b950cae tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:50.793372 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-426f3868-e713-45c1-a470-78755b950cae tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] HTTP exception thrown: Instance 1f9fc922-6315-4ec5-adda-8d3b6c1b3730 could not be found. Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-426f3868-e713-45c1-a470-78755b950cae tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Request method failure captured: Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 HTTP/1.1 Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKvpwJ94HuEq_q4R99gqLjYIznsizHpGnlhShrlqQ0u6pbV5Q2_xqg7goXXGrzo3rouLLghi-9bRHqvs5JsBq2vZ-YAsoOgRGsBKt_2RmmUlgbsPIKED3ANIrle4iaZpIw2XTuNs2A-jYtp7prv8dcSWIboK2GVVwU6sbt5S5TlVJ8 Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: e612f06f547449ac9e9b95dcd32d5928 Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-VolumesActionsTest-1494790760 Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:31:50.798230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e612f06f547449ac9e9b95dcd32d5928"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e612f06f547449ac9e9b95dcd32d5928"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e612f06f547449ac9e9b95dcd32d5928"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e612f06f547449ac9e9b95dcd32d5928"}]}] Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-VolumesActionsTest-1494790760 Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: e612f06f547449ac9e9b95dcd32d5928 Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-VolumesActionsTest-1494790760 Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-VolumesActionsTest-1494790760-project Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: ca97ac5a572b4c52804a26f5e6b8320b Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-VolumesActionsTest-1494790760-project Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance 1f9fc922-6315-4ec5-adda-8d3b6c1b3730 could not be found. Jul 21 06:31:50.799463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '1f9fc922-6315-4ec5-adda-8d3b6c1b3730'} Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9fc922-6315-4ec5-adda-8d3b6c1b3730 could not be found. Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:31:50.800175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9fc922-6315-4ec5-adda-8d3b6c1b3730 could not be found. Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9fc922-6315-4ec5-adda-8d3b6c1b3730 could not be found. Jul 21 06:31:50.801274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:31:50.803980 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-426f3868-e713-45c1-a470-78755b950cae tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Returning 404 to user: Instance 1f9fc922-6315-4ec5-adda-8d3b6c1b3730 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:31:50.803980 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-426f3868-e713-45c1-a470-78755b950cae tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730" status: 404 len: 111 microversion: 2.1 time: 0.036046 Jul 21 06:31:50.803980 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 129/266] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:50 2022] GET /compute/v2.1/servers/1f9fc922-6315-4ec5-adda-8d3b6c1b3730 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:31:50.828918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9765fa98-8290-4acd-bcef-638ff4131058 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:50.828918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9765fa98-8290-4acd-bcef-638ff4131058 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:50.838761 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9765fa98-8290-4acd-bcef-638ff4131058 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:50.839208 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9765fa98-8290-4acd-bcef-638ff4131058 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:50.839978 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9765fa98-8290-4acd-bcef-638ff4131058 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:50.840412 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9765fa98-8290-4acd-bcef-638ff4131058 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:50.934133 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1309174315", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "networks": [{"uuid": "fc29e600-c087-44b3-9b0a-d2e20e1a4dac"}]}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:51.001157 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.network.neutron [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] validate_networks() for [('fc29e600-c087-44b3-9b0a-d2e20e1a4dac', None, None, None, None, None)] {{(pid=117905) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:31:51.005296 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9765fa98-8290-4acd-bcef-638ff4131058 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:51.014216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9765fa98-8290-4acd-bcef-638ff4131058 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.190994 Jul 21 06:31:51.025194 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 138/267] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:50 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:31:51.398364 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Flavor limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:31:51.398899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Image limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:31:51.399445 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Flavor pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:31:51.400261 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Image pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:31:51.400797 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:31:51.410443 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:51.410899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:51.411703 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:51.412763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:51.431366 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Getting quotas for project e612f06f547449ac9e9b95dcd32d5928. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:31:51.437025 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Getting quotas for user ca97ac5a572b4c52804a26f5e6b8320b and project e612f06f547449ac9e9b95dcd32d5928. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:31:51.450206 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Going to run 1 instances... {{(pid=117905) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:31:51.452931 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:31:51.506918 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-62d05ff6-d568-49bb-a08b-90fb7c0b4cbc tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579778 Jul 21 06:31:51.507775 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 130/268] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:31:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:31:51.518286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-40f7631e-7974-4d13-8cc9-6042b4e8e691 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:51.518914 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-40f7631e-7974-4d13-8cc9-6042b4e8e691 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:51.601027 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-40f7631e-7974-4d13-8cc9-6042b4e8e691 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:51.609187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-40f7631e-7974-4d13-8cc9-6042b4e8e691 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1214 microversion: 2.1 time: 0.094841 Jul 21 06:31:51.610207 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 139/269] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:51 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:52.035119 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e850e2d6-2a57-49d4-a0e7-adfce2d11867 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:52.037590 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e850e2d6-2a57-49d4-a0e7-adfce2d11867 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:52.047276 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e850e2d6-2a57-49d4-a0e7-adfce2d11867 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:52.048204 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e850e2d6-2a57-49d4-a0e7-adfce2d11867 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:52.049510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e850e2d6-2a57-49d4-a0e7-adfce2d11867 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:52.050730 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e850e2d6-2a57-49d4-a0e7-adfce2d11867 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:52.219627 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e850e2d6-2a57-49d4-a0e7-adfce2d11867 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:52.228462 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e850e2d6-2a57-49d4-a0e7-adfce2d11867 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.199063 Jul 21 06:31:52.229043 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 131/270] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:52 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:52.626976 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-824d759e-bc94-4433-a813-485f6d761cfe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:52.627590 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-824d759e-bc94-4433-a813-485f6d761cfe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:52.633748 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-824d759e-bc94-4433-a813-485f6d761cfe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:52.634229 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-824d759e-bc94-4433-a813-485f6d761cfe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:52.634987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-824d759e-bc94-4433-a813-485f6d761cfe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:52.635436 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-824d759e-bc94-4433-a813-485f6d761cfe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:52.700830 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-824d759e-bc94-4433-a813-485f6d761cfe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:52.708215 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-824d759e-bc94-4433-a813-485f6d761cfe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1266 microversion: 2.1 time: 0.085185 Jul 21 06:31:52.709305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 140/271] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:52 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:53.246168 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ef1a62ff-bac3-4098-9732-ca88289b7d13 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:53.246955 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ef1a62ff-bac3-4098-9732-ca88289b7d13 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:53.253508 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ef1a62ff-bac3-4098-9732-ca88289b7d13 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:53.254120 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ef1a62ff-bac3-4098-9732-ca88289b7d13 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:53.255026 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ef1a62ff-bac3-4098-9732-ca88289b7d13 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:53.255678 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ef1a62ff-bac3-4098-9732-ca88289b7d13 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:53.277121 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:53.401388 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ef1a62ff-bac3-4098-9732-ca88289b7d13 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:53.409518 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ef1a62ff-bac3-4098-9732-ca88289b7d13 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.168792 Jul 21 06:31:53.410137 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 132/272] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:53 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:53.726309 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-784a2d79-9f15-4336-ba2c-733bfeb2f47d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:53.726939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-784a2d79-9f15-4336-ba2c-733bfeb2f47d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:53.733009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-784a2d79-9f15-4336-ba2c-733bfeb2f47d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:53.733647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-784a2d79-9f15-4336-ba2c-733bfeb2f47d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:53.734439 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-784a2d79-9f15-4336-ba2c-733bfeb2f47d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:53.735115 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-784a2d79-9f15-4336-ba2c-733bfeb2f47d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:53.890942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-784a2d79-9f15-4336-ba2c-733bfeb2f47d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:53.901652 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-784a2d79-9f15-4336-ba2c-733bfeb2f47d tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1314 microversion: 2.1 time: 0.179463 Jul 21 06:31:53.902274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 141/273] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:53 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:54.428756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8da77d6f-a738-4485-9c3d-ad06a983e4f6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:54.429476 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8da77d6f-a738-4485-9c3d-ad06a983e4f6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:54.437521 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8da77d6f-a738-4485-9c3d-ad06a983e4f6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:54.438109 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8da77d6f-a738-4485-9c3d-ad06a983e4f6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:54.439383 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8da77d6f-a738-4485-9c3d-ad06a983e4f6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:54.440078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8da77d6f-a738-4485-9c3d-ad06a983e4f6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:54.575974 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-938abde3-9228-47dd-9885-2084ca1d285f req-974f91a1-c23a-4719-86fb-9b24a48f462b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7df41fc-34aa-4aa7-8c69-1785861c77a4", "tag": "de0b9c1b-0d7d-4dc9-99d6-f45077c4cb1d"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:31:54.592274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-938abde3-9228-47dd-9885-2084ca1d285f req-974f91a1-c23a-4719-86fb-9b24a48f462b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:54.593172 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-938abde3-9228-47dd-9885-2084ca1d285f req-974f91a1-c23a-4719-86fb-9b24a48f462b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:54.608115 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-938abde3-9228-47dd-9885-2084ca1d285f req-974f91a1-c23a-4719-86fb-9b24a48f462b service nova] Creating event network-changed:de0b9c1b-0d7d-4dc9-99d6-f45077c4cb1d for instance c7df41fc-34aa-4aa7-8c69-1785861c77a4 on hv-cinder-85031 Jul 21 06:31:54.614641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-938abde3-9228-47dd-9885-2084ca1d285f req-974f91a1-c23a-4719-86fb-9b24a48f462b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047404 Jul 21 06:31:54.616203 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 142/274] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:31:54.620978 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8da77d6f-a738-4485-9c3d-ad06a983e4f6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:54.629107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8da77d6f-a738-4485-9c3d-ad06a983e4f6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.205599 Jul 21 06:31:54.631571 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 133/275] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:54 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:54.919228 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c9776a16-8f83-49c0-bf5a-3679e58d7a36 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:54.920491 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c9776a16-8f83-49c0-bf5a-3679e58d7a36 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:54.927973 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9776a16-8f83-49c0-bf5a-3679e58d7a36 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:54.928895 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9776a16-8f83-49c0-bf5a-3679e58d7a36 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:54.929671 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9776a16-8f83-49c0-bf5a-3679e58d7a36 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:54.930372 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9776a16-8f83-49c0-bf5a-3679e58d7a36 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:55.094240 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c9776a16-8f83-49c0-bf5a-3679e58d7a36 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:55.102695 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c9776a16-8f83-49c0-bf5a-3679e58d7a36 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1314 microversion: 2.1 time: 0.187590 Jul 21 06:31:55.103595 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 143/276] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:54 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:55.652332 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-088bdad3-05e6-42e8-9130-5dbff4ff9213 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:55.652970 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-088bdad3-05e6-42e8-9130-5dbff4ff9213 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:55.659471 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-088bdad3-05e6-42e8-9130-5dbff4ff9213 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:55.659925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-088bdad3-05e6-42e8-9130-5dbff4ff9213 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:55.660680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-088bdad3-05e6-42e8-9130-5dbff4ff9213 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:55.661110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-088bdad3-05e6-42e8-9130-5dbff4ff9213 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:55.797180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-088bdad3-05e6-42e8-9130-5dbff4ff9213 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:55.806001 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-088bdad3-05e6-42e8-9130-5dbff4ff9213 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.157975 Jul 21 06:31:55.806581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 134/277] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:55 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:56.120145 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-cc79e436-eb3e-4e17-8075-a5c06b5e6671 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:56.120766 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-cc79e436-eb3e-4e17-8075-a5c06b5e6671 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:56.126764 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cc79e436-eb3e-4e17-8075-a5c06b5e6671 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:56.127215 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cc79e436-eb3e-4e17-8075-a5c06b5e6671 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:56.128015 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cc79e436-eb3e-4e17-8075-a5c06b5e6671 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:56.128429 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cc79e436-eb3e-4e17-8075-a5c06b5e6671 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:56.273047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-cc79e436-eb3e-4e17-8075-a5c06b5e6671 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:56.280983 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-cc79e436-eb3e-4e17-8075-a5c06b5e6671 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1314 microversion: 2.1 time: 0.164705 Jul 21 06:31:56.281553 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 144/278] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:56 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:56.823364 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3374ee4f-5506-40b4-9df0-d1ab0a4f4f70 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:56.823984 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3374ee4f-5506-40b4-9df0-d1ab0a4f4f70 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:56.830482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3374ee4f-5506-40b4-9df0-d1ab0a4f4f70 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:56.830859 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3374ee4f-5506-40b4-9df0-d1ab0a4f4f70 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:56.834799 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3374ee4f-5506-40b4-9df0-d1ab0a4f4f70 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:56.834799 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3374ee4f-5506-40b4-9df0-d1ab0a4f4f70 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:56.987018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3374ee4f-5506-40b4-9df0-d1ab0a4f4f70 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:56.997066 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3374ee4f-5506-40b4-9df0-d1ab0a4f4f70 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.177468 Jul 21 06:31:56.997656 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 135/279] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:56 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:57.298756 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8c8a2168-f21b-4b9c-9bcd-77105aa25bf6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:57.300156 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8c8a2168-f21b-4b9c-9bcd-77105aa25bf6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:57.304991 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=76 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:31:57.310679 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c8a2168-f21b-4b9c-9bcd-77105aa25bf6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:57.311101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c8a2168-f21b-4b9c-9bcd-77105aa25bf6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:57.311897 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c8a2168-f21b-4b9c-9bcd-77105aa25bf6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:57.312499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c8a2168-f21b-4b9c-9bcd-77105aa25bf6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:57.489069 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8c8a2168-f21b-4b9c-9bcd-77105aa25bf6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:57.497144 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8c8a2168-f21b-4b9c-9bcd-77105aa25bf6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1314 microversion: 2.1 time: 0.202161 Jul 21 06:31:57.497723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 145/280] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:57 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:58.014490 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-aab6afc0-93c9-4e1b-8889-f725eb77a9b6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:58.015140 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-aab6afc0-93c9-4e1b-8889-f725eb77a9b6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:58.021621 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aab6afc0-93c9-4e1b-8889-f725eb77a9b6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:58.022664 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aab6afc0-93c9-4e1b-8889-f725eb77a9b6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:58.023532 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aab6afc0-93c9-4e1b-8889-f725eb77a9b6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:58.024154 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aab6afc0-93c9-4e1b-8889-f725eb77a9b6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:58.181592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-aab6afc0-93c9-4e1b-8889-f725eb77a9b6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:58.189705 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-aab6afc0-93c9-4e1b-8889-f725eb77a9b6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.178947 Jul 21 06:31:58.190351 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 136/281] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:58 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:58.516366 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e68729f3-6060-422a-b92f-279887b6a972 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:58.516366 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e68729f3-6060-422a-b92f-279887b6a972 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:58.522313 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e68729f3-6060-422a-b92f-279887b6a972 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:58.522812 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e68729f3-6060-422a-b92f-279887b6a972 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:58.523594 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e68729f3-6060-422a-b92f-279887b6a972 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:58.524153 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e68729f3-6060-422a-b92f-279887b6a972 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:58.662275 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e68729f3-6060-422a-b92f-279887b6a972 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:58.670830 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e68729f3-6060-422a-b92f-279887b6a972 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1314 microversion: 2.1 time: 0.160382 Jul 21 06:31:58.671413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 146/282] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:58 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:59.206896 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0913582a-3969-40ac-a621-d52bcb2f0291 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:59.207413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0913582a-3969-40ac-a621-d52bcb2f0291 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:59.215163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0913582a-3969-40ac-a621-d52bcb2f0291 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:59.215913 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0913582a-3969-40ac-a621-d52bcb2f0291 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:59.217202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0913582a-3969-40ac-a621-d52bcb2f0291 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:59.217202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0913582a-3969-40ac-a621-d52bcb2f0291 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:59.366463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0913582a-3969-40ac-a621-d52bcb2f0291 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:59.373919 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0913582a-3969-40ac-a621-d52bcb2f0291 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.170897 Jul 21 06:31:59.374713 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 137/283] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:59 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:31:59.687969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-16f59ab9-f535-414d-af00-d253ee3ed2fe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:31:59.688509 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-16f59ab9-f535-414d-af00-d253ee3ed2fe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:31:59.695421 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-16f59ab9-f535-414d-af00-d253ee3ed2fe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:59.695841 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-16f59ab9-f535-414d-af00-d253ee3ed2fe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:59.696606 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-16f59ab9-f535-414d-af00-d253ee3ed2fe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:31:59.697061 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-16f59ab9-f535-414d-af00-d253ee3ed2fe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:31:59.836191 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-16f59ab9-f535-414d-af00-d253ee3ed2fe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:31:59.843518 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-16f59ab9-f535-414d-af00-d253ee3ed2fe tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1314 microversion: 2.1 time: 0.159635 Jul 21 06:31:59.844192 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 147/284] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:31:59 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:00.390419 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-95d7b3ae-8a5e-46a7-92b3-9ae661adbe50 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:00.391040 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-95d7b3ae-8a5e-46a7-92b3-9ae661adbe50 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:00.399052 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95d7b3ae-8a5e-46a7-92b3-9ae661adbe50 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:00.399797 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95d7b3ae-8a5e-46a7-92b3-9ae661adbe50 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:00.400592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95d7b3ae-8a5e-46a7-92b3-9ae661adbe50 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:00.401030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95d7b3ae-8a5e-46a7-92b3-9ae661adbe50 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:00.553378 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-95d7b3ae-8a5e-46a7-92b3-9ae661adbe50 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:00.561322 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-95d7b3ae-8a5e-46a7-92b3-9ae661adbe50 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.174680 Jul 21 06:32:00.561898 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 138/285] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:00 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:00.860573 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0ee11926-6a6a-45c1-a45b-e2a863ea12e1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:00.866094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0ee11926-6a6a-45c1-a45b-e2a863ea12e1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:00.868746 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ee11926-6a6a-45c1-a45b-e2a863ea12e1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:00.869277 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ee11926-6a6a-45c1-a45b-e2a863ea12e1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:00.870231 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ee11926-6a6a-45c1-a45b-e2a863ea12e1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:00.871046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ee11926-6a6a-45c1-a45b-e2a863ea12e1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:01.080967 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0ee11926-6a6a-45c1-a45b-e2a863ea12e1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:01.090499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0ee11926-6a6a-45c1-a45b-e2a863ea12e1 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1314 microversion: 2.1 time: 0.233661 Jul 21 06:32:01.091313 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 148/286] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:00 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:01.530700 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-1b3856b9-97d5-4335-816b-71e6e4f91295 req-6ab2eec2-eb12-4dad-8741-1a54b0fbbbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7df41fc-34aa-4aa7-8c69-1785861c77a4", "name": "network-vif-plugged", "status": "completed", "tag": "de0b9c1b-0d7d-4dc9-99d6-f45077c4cb1d"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:01.546307 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:01.547565 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=6 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:01.549864 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-1b3856b9-97d5-4335-816b-71e6e4f91295 req-6ab2eec2-eb12-4dad-8741-1a54b0fbbbf9 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:01.550518 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-1b3856b9-97d5-4335-816b-71e6e4f91295 req-6ab2eec2-eb12-4dad-8741-1a54b0fbbbf9 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:01.577804 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-1b3856b9-97d5-4335-816b-71e6e4f91295 req-6ab2eec2-eb12-4dad-8741-1a54b0fbbbf9 service nova] Creating event network-vif-plugged:de0b9c1b-0d7d-4dc9-99d6-f45077c4cb1d for instance c7df41fc-34aa-4aa7-8c69-1785861c77a4 on hv-cinder-85031 Jul 21 06:32:01.582422 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a7fb03e9-f27e-457a-b4b6-b956997c4bab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:01.583953 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a7fb03e9-f27e-457a-b4b6-b956997c4bab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:01.586774 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-1b3856b9-97d5-4335-816b-71e6e4f91295 req-6ab2eec2-eb12-4dad-8741-1a54b0fbbbf9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059521 Jul 21 06:32:01.588718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 139/287] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:32:01.592502 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a7fb03e9-f27e-457a-b4b6-b956997c4bab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:01.593318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a7fb03e9-f27e-457a-b4b6-b956997c4bab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:01.594449 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a7fb03e9-f27e-457a-b4b6-b956997c4bab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:01.595000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a7fb03e9-f27e-457a-b4b6-b956997c4bab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:01.788219 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:01.970921 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a7fb03e9-f27e-457a-b4b6-b956997c4bab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:01.983398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a7fb03e9-f27e-457a-b4b6-b956997c4bab tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.406921 Jul 21 06:32:01.993410 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 149/288] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:01 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:02.108687 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-792066b6-25e7-49ac-9e4b-2f144b6870e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:02.113745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-792066b6-25e7-49ac-9e4b-2f144b6870e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:02.138984 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-792066b6-25e7-49ac-9e4b-2f144b6870e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:02.140222 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-792066b6-25e7-49ac-9e4b-2f144b6870e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:02.141018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-792066b6-25e7-49ac-9e4b-2f144b6870e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:02.141454 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-792066b6-25e7-49ac-9e4b-2f144b6870e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:02.414819 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-792066b6-25e7-49ac-9e4b-2f144b6870e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:02.433510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-792066b6-25e7-49ac-9e4b-2f144b6870e6 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1314 microversion: 2.1 time: 0.328345 Jul 21 06:32:02.434688 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 140/289] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:02 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:03.001997 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bcd87a6c-88ba-4586-a9d8-1ad7335b74fd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:03.002782 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bcd87a6c-88ba-4586-a9d8-1ad7335b74fd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:03.015237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bcd87a6c-88ba-4586-a9d8-1ad7335b74fd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:03.016497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bcd87a6c-88ba-4586-a9d8-1ad7335b74fd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:03.017491 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bcd87a6c-88ba-4586-a9d8-1ad7335b74fd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:03.017926 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bcd87a6c-88ba-4586-a9d8-1ad7335b74fd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:03.184160 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bcd87a6c-88ba-4586-a9d8-1ad7335b74fd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:03.195338 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bcd87a6c-88ba-4586-a9d8-1ad7335b74fd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.198246 Jul 21 06:32:03.195871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 150/290] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:02 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:03.451237 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c3793aa4-8886-446d-b39d-32f945587ebf tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:03.451895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c3793aa4-8886-446d-b39d-32f945587ebf tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:03.459085 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c3793aa4-8886-446d-b39d-32f945587ebf tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:03.459833 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c3793aa4-8886-446d-b39d-32f945587ebf tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:03.460818 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c3793aa4-8886-446d-b39d-32f945587ebf tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:03.461882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c3793aa4-8886-446d-b39d-32f945587ebf tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:03.622466 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c3793aa4-8886-446d-b39d-32f945587ebf tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:03.632654 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c3793aa4-8886-446d-b39d-32f945587ebf tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1314 microversion: 2.1 time: 0.185586 Jul 21 06:32:03.633252 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 141/291] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:03 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:04.212415 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-464c8311-c80b-447f-9667-be8c7d71a032 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:04.213667 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-464c8311-c80b-447f-9667-be8c7d71a032 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:04.219651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-464c8311-c80b-447f-9667-be8c7d71a032 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:04.220430 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-464c8311-c80b-447f-9667-be8c7d71a032 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:04.221904 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-464c8311-c80b-447f-9667-be8c7d71a032 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:04.222516 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-464c8311-c80b-447f-9667-be8c7d71a032 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:04.464229 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-464c8311-c80b-447f-9667-be8c7d71a032 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:04.473176 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-464c8311-c80b-447f-9667-be8c7d71a032 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1522 microversion: 2.1 time: 0.264584 Jul 21 06:32:04.476024 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 151/292] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:04 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:04.654957 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-26f765af-a141-4558-a2b6-3fff143790a0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:04.658069 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-26f765af-a141-4558-a2b6-3fff143790a0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:04.694415 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-26f765af-a141-4558-a2b6-3fff143790a0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:04.694961 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-26f765af-a141-4558-a2b6-3fff143790a0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:04.695802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-26f765af-a141-4558-a2b6-3fff143790a0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:04.698582 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-26f765af-a141-4558-a2b6-3fff143790a0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:05.041867 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-26f765af-a141-4558-a2b6-3fff143790a0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:05.060582 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-26f765af-a141-4558-a2b6-3fff143790a0 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1499 microversion: 2.1 time: 0.414490 Jul 21 06:32:05.061173 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 142/293] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:04 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1499 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:05.493173 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-40fc077f-4374-4a0d-9081-154e0c974fbd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:05.493774 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-40fc077f-4374-4a0d-9081-154e0c974fbd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:05.507032 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-40fc077f-4374-4a0d-9081-154e0c974fbd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:05.507516 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-40fc077f-4374-4a0d-9081-154e0c974fbd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:05.508794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-40fc077f-4374-4a0d-9081-154e0c974fbd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:05.509221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-40fc077f-4374-4a0d-9081-154e0c974fbd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:05.801200 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-40fc077f-4374-4a0d-9081-154e0c974fbd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:05.809977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-40fc077f-4374-4a0d-9081-154e0c974fbd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1502 microversion: 2.1 time: 0.320666 Jul 21 06:32:05.810642 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 152/294] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:05 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1502 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:05.831099 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-caa9f878-c3e7-4da1-8aed-5044c99a1232 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:05.842427 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-caa9f878-c3e7-4da1-8aed-5044c99a1232 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:05.853271 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-caa9f878-c3e7-4da1-8aed-5044c99a1232 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:05.859742 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-caa9f878-c3e7-4da1-8aed-5044c99a1232 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:05.860772 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-caa9f878-c3e7-4da1-8aed-5044c99a1232 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:05.861223 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-caa9f878-c3e7-4da1-8aed-5044c99a1232 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:05.862679 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-63f9e272-8776-4db4-88f1-5eb2704bb8f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:05.863366 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-63f9e272-8776-4db4-88f1-5eb2704bb8f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:05.874659 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-63f9e272-8776-4db4-88f1-5eb2704bb8f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:05.875372 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-63f9e272-8776-4db4-88f1-5eb2704bb8f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:05.876333 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-63f9e272-8776-4db4-88f1-5eb2704bb8f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:05.876929 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-63f9e272-8776-4db4-88f1-5eb2704bb8f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:05.914922 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-63f9e272-8776-4db4-88f1-5eb2704bb8f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:32:05.961993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:06.063493 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-63f9e272-8776-4db4-88f1-5eb2704bb8f5 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 204 len: 0 microversion: 2.1 time: 0.202148 Jul 21 06:32:06.064325 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 153/295] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:32:05 2022] DELETE /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:32:06.074763 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-731433eb-f6c2-48d6-ad24-027757e16ff3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:06.075486 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-731433eb-f6c2-48d6-ad24-027757e16ff3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:06.077266 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-caa9f878-c3e7-4da1-8aed-5044c99a1232 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:06.084357 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-731433eb-f6c2-48d6-ad24-027757e16ff3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:06.084821 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-731433eb-f6c2-48d6-ad24-027757e16ff3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:06.085993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-731433eb-f6c2-48d6-ad24-027757e16ff3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:06.086443 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-731433eb-f6c2-48d6-ad24-027757e16ff3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:06.088413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-caa9f878-c3e7-4da1-8aed-5044c99a1232 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1517 microversion: 2.1 time: 0.264237 Jul 21 06:32:06.098487 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 143/296] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:05 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:06.263163 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-731433eb-f6c2-48d6-ad24-027757e16ff3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:06.272214 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-731433eb-f6c2-48d6-ad24-027757e16ff3 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1505 microversion: 2.1 time: 0.202421 Jul 21 06:32:06.273070 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 154/297] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:06 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:07.293884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4d9b2335-d9a0-4470-922f-ca2eee32581b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:07.294643 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4d9b2335-d9a0-4470-922f-ca2eee32581b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:07.301293 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d9b2335-d9a0-4470-922f-ca2eee32581b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:07.301744 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d9b2335-d9a0-4470-922f-ca2eee32581b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:07.303578 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d9b2335-d9a0-4470-922f-ca2eee32581b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:07.304020 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d9b2335-d9a0-4470-922f-ca2eee32581b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:07.494676 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4d9b2335-d9a0-4470-922f-ca2eee32581b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:07.503419 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4d9b2335-d9a0-4470-922f-ca2eee32581b tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1505 microversion: 2.1 time: 0.213319 Jul 21 06:32:07.504551 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 144/298] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:07 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:07.575181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ce58a40d-1895-4b15-8104-988000cc496e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:07.580808 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ce58a40d-1895-4b15-8104-988000cc496e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:07.590295 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ce58a40d-1895-4b15-8104-988000cc496e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:07.591097 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ce58a40d-1895-4b15-8104-988000cc496e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:07.592047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ce58a40d-1895-4b15-8104-988000cc496e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:07.592647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ce58a40d-1895-4b15-8104-988000cc496e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:07.620468 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-ce58a40d-1895-4b15-8104-988000cc496e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lazy-loading 'flavor' on Instance uuid 746e5366-e38d-4694-b0dc-5d71af0c69d3 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:32:07.723519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ce58a40d-1895-4b15-8104-988000cc496e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3/action" status: 200 len: 32 microversion: 2.1 time: 0.152005 Jul 21 06:32:07.726385 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 155/299] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:32:07 2022] POST /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:32:07.736510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0bd3f635-80d1-4182-8e6b-90b4b4884099 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:07.737129 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0bd3f635-80d1-4182-8e6b-90b4b4884099 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:07.748274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0bd3f635-80d1-4182-8e6b-90b4b4884099 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:07.749070 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0bd3f635-80d1-4182-8e6b-90b4b4884099 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:07.756603 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0bd3f635-80d1-4182-8e6b-90b4b4884099 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:07.757550 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0bd3f635-80d1-4182-8e6b-90b4b4884099 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:07.931159 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0bd3f635-80d1-4182-8e6b-90b4b4884099 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:07.939495 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0bd3f635-80d1-4182-8e6b-90b4b4884099 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.208138 Jul 21 06:32:07.940413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 145/300] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:07 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:08.524934 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-38bb9c85-c2fa-4b5b-afa7-3578789dbd72 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:08.525904 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-38bb9c85-c2fa-4b5b-afa7-3578789dbd72 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:08.551901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-38bb9c85-c2fa-4b5b-afa7-3578789dbd72 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:08.551901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-38bb9c85-c2fa-4b5b-afa7-3578789dbd72 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:08.571254 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-38bb9c85-c2fa-4b5b-afa7-3578789dbd72 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:08.571709 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-38bb9c85-c2fa-4b5b-afa7-3578789dbd72 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:08.960728 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-aab13c13-781e-4cc9-ada6-d389801d47e9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:08.962013 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-aab13c13-781e-4cc9-ada6-d389801d47e9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:08.975097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aab13c13-781e-4cc9-ada6-d389801d47e9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:08.976028 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aab13c13-781e-4cc9-ada6-d389801d47e9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:08.977051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aab13c13-781e-4cc9-ada6-d389801d47e9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:08.977659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aab13c13-781e-4cc9-ada6-d389801d47e9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:09.184941 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-38bb9c85-c2fa-4b5b-afa7-3578789dbd72 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:09.200808 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-38bb9c85-c2fa-4b5b-afa7-3578789dbd72 tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1505 microversion: 2.1 time: 0.682637 Jul 21 06:32:09.201471 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 156/301] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:08 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1505 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:09.325210 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-aab13c13-781e-4cc9-ada6-d389801d47e9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:09.335116 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-aab13c13-781e-4cc9-ada6-d389801d47e9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.380482 Jul 21 06:32:09.340958 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 146/302] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:08 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:09.592889 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-37d9a5f8-7109-4070-a52e-70028b51dce0 req-d3ec7761-c18a-4307-b419-78ece4630051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7df41fc-34aa-4aa7-8c69-1785861c77a4", "name": "network-vif-deleted", "tag": "de0b9c1b-0d7d-4dc9-99d6-f45077c4cb1d"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:09.616680 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-37d9a5f8-7109-4070-a52e-70028b51dce0 req-d3ec7761-c18a-4307-b419-78ece4630051 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:09.628403 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-37d9a5f8-7109-4070-a52e-70028b51dce0 req-d3ec7761-c18a-4307-b419-78ece4630051 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:09.656993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-37d9a5f8-7109-4070-a52e-70028b51dce0 req-d3ec7761-c18a-4307-b419-78ece4630051 service nova] Creating event network-vif-deleted:de0b9c1b-0d7d-4dc9-99d6-f45077c4cb1d for instance c7df41fc-34aa-4aa7-8c69-1785861c77a4 on hv-cinder-85031 Jul 21 06:32:09.668705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-37d9a5f8-7109-4070-a52e-70028b51dce0 req-d3ec7761-c18a-4307-b419-78ece4630051 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079190 Jul 21 06:32:09.674057 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 157/303] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:32:10.225969 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:10.226810 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:10.234208 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:10.234704 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:10.235990 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:10.236763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:10.292109 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:10.292689 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:10.297857 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lazy-loading 'fault' on Instance uuid c7df41fc-34aa-4aa7-8c69-1785861c77a4 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:32:10.356616 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5bfb085d-6868-4ec0-bcf8-0f4e91b5f818 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:10.357435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5bfb085d-6868-4ec0-bcf8-0f4e91b5f818 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:10.358107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca97ac5a572b4c52804a26f5e6b8320b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612f06f547449ac9e9b95dcd32d5928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:10.366124 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5bfb085d-6868-4ec0-bcf8-0f4e91b5f818 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:10.375298 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4ecf4862-f459-4eef-ab3b-cea870999fab tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 200 len: 1304 microversion: 2.1 time: 0.159360 Jul 21 06:32:10.375907 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5bfb085d-6868-4ec0-bcf8-0f4e91b5f818 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:10.376069 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 147/304] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:10 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:10.385760 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5bfb085d-6868-4ec0-bcf8-0f4e91b5f818 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:10.386304 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5bfb085d-6868-4ec0-bcf8-0f4e91b5f818 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:10.625918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5bfb085d-6868-4ec0-bcf8-0f4e91b5f818 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:10.637523 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5bfb085d-6868-4ec0-bcf8-0f4e91b5f818 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.288985 Jul 21 06:32:10.651920 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 158/305] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:10 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:11.392842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fe26dfba-1960-438e-b56b-727763bcb34e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:11.393624 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fe26dfba-1960-438e-b56b-727763bcb34e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] [instance: c7df41fc-34aa-4aa7-8c69-1785861c77a4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:11.403254 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fe26dfba-1960-438e-b56b-727763bcb34e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:11.403885 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fe26dfba-1960-438e-b56b-727763bcb34e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:11.413227 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fe26dfba-1960-438e-b56b-727763bcb34e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:11.414093 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fe26dfba-1960-438e-b56b-727763bcb34e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:11.431552 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-fe26dfba-1960-438e-b56b-727763bcb34e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] HTTP exception thrown: Instance c7df41fc-34aa-4aa7-8c69-1785861c77a4 could not be found. Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fe26dfba-1960-438e-b56b-727763bcb34e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Request method failure captured: Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 HTTP/1.1 Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKvpwJ94HuEq_q4R99gqLjYIznsizHpGnlhShrlqQ0u6pbV5Q2_xqg7goXXGrzo3rouLLghi-9bRHqvs5JsBq2vZ-YAsoOgRGsBKt_2RmmUlgbsPIKED3ANIrle4iaZpIw2XTuNs2A-jYtp7prv8dcSWIboK2GVVwU6sbt5S5TlVJ8 Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: e612f06f547449ac9e9b95dcd32d5928 Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-VolumesActionsTest-1494790760 Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:32:11.433409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e612f06f547449ac9e9b95dcd32d5928"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e612f06f547449ac9e9b95dcd32d5928"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e612f06f547449ac9e9b95dcd32d5928"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e612f06f547449ac9e9b95dcd32d5928"}]}] Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-VolumesActionsTest-1494790760 Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: e612f06f547449ac9e9b95dcd32d5928 Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-VolumesActionsTest-1494790760 Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-VolumesActionsTest-1494790760-project Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: ca97ac5a572b4c52804a26f5e6b8320b Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-VolumesActionsTest-1494790760-project Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance c7df41fc-34aa-4aa7-8c69-1785861c77a4 could not be found. Jul 21 06:32:11.434890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': 'c7df41fc-34aa-4aa7-8c69-1785861c77a4'} Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7df41fc-34aa-4aa7-8c69-1785861c77a4 could not be found. Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:32:11.435763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7df41fc-34aa-4aa7-8c69-1785861c77a4 could not be found. Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7df41fc-34aa-4aa7-8c69-1785861c77a4 could not be found. Jul 21 06:32:11.437267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:32:11.438480 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fe26dfba-1960-438e-b56b-727763bcb34e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] Returning 404 to user: Instance c7df41fc-34aa-4aa7-8c69-1785861c77a4 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:32:11.438703 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fe26dfba-1960-438e-b56b-727763bcb34e tempest-VolumesActionsTest-1494790760 tempest-VolumesActionsTest-1494790760-project] 10.222.0.42 "GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4" status: 404 len: 111 microversion: 2.1 time: 0.049631 Jul 21 06:32:11.439829 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 148/306] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:11 2022] GET /compute/v2.1/servers/c7df41fc-34aa-4aa7-8c69-1785861c77a4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:32:11.658254 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-89ec78a2-65f3-4417-9f3b-bc95139d6783 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:11.660972 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-89ec78a2-65f3-4417-9f3b-bc95139d6783 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:11.677883 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-89ec78a2-65f3-4417-9f3b-bc95139d6783 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:11.678401 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-89ec78a2-65f3-4417-9f3b-bc95139d6783 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:11.679210 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-89ec78a2-65f3-4417-9f3b-bc95139d6783 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:11.693522 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-89ec78a2-65f3-4417-9f3b-bc95139d6783 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:11.971548 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-89ec78a2-65f3-4417-9f3b-bc95139d6783 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:11.982134 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-89ec78a2-65f3-4417-9f3b-bc95139d6783 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.327618 Jul 21 06:32:11.982134 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 159/307] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:11 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:12.905971 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-10f6f864-3dc9-440d-b71b-f76e0c3ced67 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Action: 'create', calling method: .version_select at 0x7f9327c88820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1128193888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMahbttRGg6tA6fEFK9tz5nciUXltUBOdnUorS+BJNo3aHanwJFnBqcim7T1gKE7gFPu5B4j1+b/PA9EPlNrmZwZA8d1CP7pK89M2vdA1SGlSWBzGCL1vksK4Irvf6qBQ=="}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:12.922921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-10f6f864-3dc9-440d-b71b-f76e0c3ced67 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Getting quotas for project 5d0ba27e9a7f450c87eb189cdd6e235b. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:32:12.927729 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-10f6f864-3dc9-440d-b71b-f76e0c3ced67 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Getting quotas for user 5439d1a65154486bb4fdfeeaf8ab4b07 and project 5d0ba27e9a7f450c87eb189cdd6e235b. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:32:12.957246 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-10f6f864-3dc9-440d-b71b-f76e0c3ced67 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.236758 Jul 21 06:32:12.958474 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 149/308] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 06:32:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:32:12.999048 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-71c0198e-c0d3-41fd-9c99-27c29b1158a5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:13.000016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-71c0198e-c0d3-41fd-9c99-27c29b1158a5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:13.007987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71c0198e-c0d3-41fd-9c99-27c29b1158a5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:13.008731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71c0198e-c0d3-41fd-9c99-27c29b1158a5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:13.009930 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71c0198e-c0d3-41fd-9c99-27c29b1158a5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:13.010650 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71c0198e-c0d3-41fd-9c99-27c29b1158a5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:13.281206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-71c0198e-c0d3-41fd-9c99-27c29b1158a5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:13.289427 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-71c0198e-c0d3-41fd-9c99-27c29b1158a5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.294493 Jul 21 06:32:13.290430 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 160/309] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:12 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:14.307558 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-082dc665-a19b-4b35-885b-22ee76dfe7d4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:14.308284 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-082dc665-a19b-4b35-885b-22ee76dfe7d4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:14.315858 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-082dc665-a19b-4b35-885b-22ee76dfe7d4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:14.316346 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-082dc665-a19b-4b35-885b-22ee76dfe7d4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:14.317189 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-082dc665-a19b-4b35-885b-22ee76dfe7d4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:14.317639 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-082dc665-a19b-4b35-885b-22ee76dfe7d4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:14.473038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-082dc665-a19b-4b35-885b-22ee76dfe7d4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:14.482870 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-082dc665-a19b-4b35-885b-22ee76dfe7d4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.179945 Jul 21 06:32:14.483505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 150/310] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:14 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:15.506280 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b6f44886-dd9c-46cb-b749-c54d48675bd4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:15.508237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b6f44886-dd9c-46cb-b749-c54d48675bd4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:15.517039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b6f44886-dd9c-46cb-b749-c54d48675bd4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:15.517662 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b6f44886-dd9c-46cb-b749-c54d48675bd4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:15.518878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b6f44886-dd9c-46cb-b749-c54d48675bd4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:15.519417 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b6f44886-dd9c-46cb-b749-c54d48675bd4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:15.696110 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b6f44886-dd9c-46cb-b749-c54d48675bd4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:15.704519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b6f44886-dd9c-46cb-b749-c54d48675bd4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.207232 Jul 21 06:32:15.705106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 161/311] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:15 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:16.722435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-dd2d7bf5-a2de-45ee-9658-00d6caa086c4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:16.723048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-dd2d7bf5-a2de-45ee-9658-00d6caa086c4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:16.726261 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:16.731703 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dd2d7bf5-a2de-45ee-9658-00d6caa086c4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:16.732163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dd2d7bf5-a2de-45ee-9658-00d6caa086c4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:16.732935 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dd2d7bf5-a2de-45ee-9658-00d6caa086c4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:16.733379 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dd2d7bf5-a2de-45ee-9658-00d6caa086c4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:16.738055 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:16.904422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-dd2d7bf5-a2de-45ee-9658-00d6caa086c4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:16.912712 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-dd2d7bf5-a2de-45ee-9658-00d6caa086c4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.193980 Jul 21 06:32:16.913217 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 151/312] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:16 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:17.930393 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1eb2abbf-a732-4153-b245-caec9a3dff39 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:17.931044 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1eb2abbf-a732-4153-b245-caec9a3dff39 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:17.938342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1eb2abbf-a732-4153-b245-caec9a3dff39 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:17.938903 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1eb2abbf-a732-4153-b245-caec9a3dff39 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:17.939839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1eb2abbf-a732-4153-b245-caec9a3dff39 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:17.940287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1eb2abbf-a732-4153-b245-caec9a3dff39 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:18.076807 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1eb2abbf-a732-4153-b245-caec9a3dff39 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:18.086300 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1eb2abbf-a732-4153-b245-caec9a3dff39 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.160040 Jul 21 06:32:18.086874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 162/313] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:17 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:19.103577 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2d01482c-a8bb-46d1-9093-8d41d070f583 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:19.104196 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2d01482c-a8bb-46d1-9093-8d41d070f583 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:19.110725 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d01482c-a8bb-46d1-9093-8d41d070f583 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:19.111179 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d01482c-a8bb-46d1-9093-8d41d070f583 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:19.111941 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d01482c-a8bb-46d1-9093-8d41d070f583 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:19.112381 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d01482c-a8bb-46d1-9093-8d41d070f583 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:19.251672 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2d01482c-a8bb-46d1-9093-8d41d070f583 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:19.259267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2d01482c-a8bb-46d1-9093-8d41d070f583 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.159554 Jul 21 06:32:19.259815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 152/314] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:19 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:20.277618 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-82e0ec48-5540-4622-82f4-01d81050e610 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:20.278256 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-82e0ec48-5540-4622-82f4-01d81050e610 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:20.284308 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-82e0ec48-5540-4622-82f4-01d81050e610 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:20.284755 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-82e0ec48-5540-4622-82f4-01d81050e610 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:20.285516 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-82e0ec48-5540-4622-82f4-01d81050e610 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:20.286592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-82e0ec48-5540-4622-82f4-01d81050e610 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:20.423522 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-82e0ec48-5540-4622-82f4-01d81050e610 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:20.431437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-82e0ec48-5540-4622-82f4-01d81050e610 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.157915 Jul 21 06:32:20.432012 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 163/315] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:20 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:21.053436 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9a868799-562e-4216-8bd9-4a716a66cb13 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:21.054000 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9a868799-562e-4216-8bd9-4a716a66cb13 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:21.060712 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a868799-562e-4216-8bd9-4a716a66cb13 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:21.061204 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a868799-562e-4216-8bd9-4a716a66cb13 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:21.062047 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a868799-562e-4216-8bd9-4a716a66cb13 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:21.062520 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a868799-562e-4216-8bd9-4a716a66cb13 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:21.087238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9a868799-562e-4216-8bd9-4a716a66cb13 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/ips" status: 200 len: 153 microversion: 2.20 time: 0.038283 Jul 21 06:32:21.087836 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 153/316] 10.222.0.42 () {60 vars in 1288 bytes} [Thu Jul 21 06:32:21 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:32:21.449987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8d9a4bcf-365c-4da1-b12b-7aaf86ea3285 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:21.451315 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8d9a4bcf-365c-4da1-b12b-7aaf86ea3285 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:21.459188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d9a4bcf-365c-4da1-b12b-7aaf86ea3285 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:21.459734 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d9a4bcf-365c-4da1-b12b-7aaf86ea3285 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:21.460632 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d9a4bcf-365c-4da1-b12b-7aaf86ea3285 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:21.461434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d9a4bcf-365c-4da1-b12b-7aaf86ea3285 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:21.611348 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8d9a4bcf-365c-4da1-b12b-7aaf86ea3285 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:21.619799 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8d9a4bcf-365c-4da1-b12b-7aaf86ea3285 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.175047 Jul 21 06:32:21.620367 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 164/317] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:21 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:22.637107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2e1c857c-bef6-4af6-9d89-421d2580557b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:22.638437 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2e1c857c-bef6-4af6-9d89-421d2580557b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:22.646070 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2e1c857c-bef6-4af6-9d89-421d2580557b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:22.646802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2e1c857c-bef6-4af6-9d89-421d2580557b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:22.647785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2e1c857c-bef6-4af6-9d89-421d2580557b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:22.648222 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2e1c857c-bef6-4af6-9d89-421d2580557b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:22.796684 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2e1c857c-bef6-4af6-9d89-421d2580557b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:22.804816 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2e1c857c-bef6-4af6-9d89-421d2580557b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.171999 Jul 21 06:32:22.805824 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 154/318] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:22 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:23.630329 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2aa0e86d-b531-4855-b723-585bf405cd2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:23.631092 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2aa0e86d-b531-4855-b723-585bf405cd2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:23.637459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2aa0e86d-b531-4855-b723-585bf405cd2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:23.637900 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2aa0e86d-b531-4855-b723-585bf405cd2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:23.639253 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2aa0e86d-b531-4855-b723-585bf405cd2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:23.639687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2aa0e86d-b531-4855-b723-585bf405cd2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:23.670535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-2aa0e86d-b531-4855-b723-585bf405cd2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lazy-loading 'flavor' on Instance uuid a40d32b1-a161-49f9-a2ae-fe794e9a66cd {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:32:23.824629 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-06fb55be-6037-4d06-a829-c5baac924431 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:23.825304 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-06fb55be-6037-4d06-a829-c5baac924431 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:23.827055 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=4 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:23.833831 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-06fb55be-6037-4d06-a829-c5baac924431 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:23.834323 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-06fb55be-6037-4d06-a829-c5baac924431 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:23.835108 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-06fb55be-6037-4d06-a829-c5baac924431 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:23.835730 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-06fb55be-6037-4d06-a829-c5baac924431 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:24.003464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-06fb55be-6037-4d06-a829-c5baac924431 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:24.012026 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-06fb55be-6037-4d06-a829-c5baac924431 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.191539 Jul 21 06:32:24.012598 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 155/319] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:23 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:25.032969 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-bc99650b-7663-4714-b0f6-35fcfb99402f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:25.033725 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-bc99650b-7663-4714-b0f6-35fcfb99402f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:25.040228 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc99650b-7663-4714-b0f6-35fcfb99402f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:25.040692 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc99650b-7663-4714-b0f6-35fcfb99402f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:25.041466 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc99650b-7663-4714-b0f6-35fcfb99402f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:25.042121 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc99650b-7663-4714-b0f6-35fcfb99402f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:25.210832 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bc99650b-7663-4714-b0f6-35fcfb99402f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:25.218564 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-bc99650b-7663-4714-b0f6-35fcfb99402f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.189461 Jul 21 06:32:25.219350 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 156/320] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:25 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:26.237717 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8aaa7808-ab25-454e-aadf-95534c898451 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:26.238403 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8aaa7808-ab25-454e-aadf-95534c898451 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:26.246463 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8aaa7808-ab25-454e-aadf-95534c898451 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:26.247007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8aaa7808-ab25-454e-aadf-95534c898451 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:26.248022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8aaa7808-ab25-454e-aadf-95534c898451 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:26.248479 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8aaa7808-ab25-454e-aadf-95534c898451 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:26.393185 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8aaa7808-ab25-454e-aadf-95534c898451 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:26.402850 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8aaa7808-ab25-454e-aadf-95534c898451 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.170465 Jul 21 06:32:26.403418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 157/321] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:26 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:27.421309 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-96ed78ee-e53a-43d4-99bd-f92c3f764976 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:27.421975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-96ed78ee-e53a-43d4-99bd-f92c3f764976 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:27.429281 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96ed78ee-e53a-43d4-99bd-f92c3f764976 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:27.429865 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96ed78ee-e53a-43d4-99bd-f92c3f764976 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:27.430811 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96ed78ee-e53a-43d4-99bd-f92c3f764976 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:27.431319 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-96ed78ee-e53a-43d4-99bd-f92c3f764976 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:27.573633 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-96ed78ee-e53a-43d4-99bd-f92c3f764976 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:27.581167 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-96ed78ee-e53a-43d4-99bd-f92c3f764976 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.163934 Jul 21 06:32:27.592457 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 158/322] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:27 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:28.600182 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-03f36aed-b575-449c-8d61-80a460722f0b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:28.601528 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-03f36aed-b575-449c-8d61-80a460722f0b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:28.608644 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-03f36aed-b575-449c-8d61-80a460722f0b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:28.609097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-03f36aed-b575-449c-8d61-80a460722f0b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:28.609888 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-03f36aed-b575-449c-8d61-80a460722f0b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:28.610355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-03f36aed-b575-449c-8d61-80a460722f0b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:28.758084 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-03f36aed-b575-449c-8d61-80a460722f0b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:28.767743 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-03f36aed-b575-449c-8d61-80a460722f0b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.172028 Jul 21 06:32:28.768328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 159/323] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:28 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:29.786403 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c6ffd900-4481-43b1-af69-5a85ea5dd4fa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:29.787844 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c6ffd900-4481-43b1-af69-5a85ea5dd4fa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:29.795353 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c6ffd900-4481-43b1-af69-5a85ea5dd4fa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:29.795809 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c6ffd900-4481-43b1-af69-5a85ea5dd4fa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:29.796592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c6ffd900-4481-43b1-af69-5a85ea5dd4fa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:29.797029 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c6ffd900-4481-43b1-af69-5a85ea5dd4fa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:30.003538 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c6ffd900-4481-43b1-af69-5a85ea5dd4fa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:30.024819 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c6ffd900-4481-43b1-af69-5a85ea5dd4fa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.242758 Jul 21 06:32:30.025415 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 160/324] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:29 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:31.047091 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b3b0d761-ee5d-4fbd-ba29-638988730841 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:31.049089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b3b0d761-ee5d-4fbd-ba29-638988730841 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:31.059778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b3b0d761-ee5d-4fbd-ba29-638988730841 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:31.060561 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b3b0d761-ee5d-4fbd-ba29-638988730841 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:31.062286 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b3b0d761-ee5d-4fbd-ba29-638988730841 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:31.063670 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b3b0d761-ee5d-4fbd-ba29-638988730841 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:31.231444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b3b0d761-ee5d-4fbd-ba29-638988730841 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:31.240679 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b3b0d761-ee5d-4fbd-ba29-638988730841 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.199528 Jul 21 06:32:31.241647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 161/325] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:31 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:32.258596 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-75ad5158-d079-4b7a-8752-4d7b5b02959b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:32.259320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-75ad5158-d079-4b7a-8752-4d7b5b02959b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:32.265932 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75ad5158-d079-4b7a-8752-4d7b5b02959b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:32.266513 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75ad5158-d079-4b7a-8752-4d7b5b02959b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:32.267165 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75ad5158-d079-4b7a-8752-4d7b5b02959b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:32.267601 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75ad5158-d079-4b7a-8752-4d7b5b02959b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:32.429406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-75ad5158-d079-4b7a-8752-4d7b5b02959b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:32.439231 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-75ad5158-d079-4b7a-8752-4d7b5b02959b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.185043 Jul 21 06:32:32.440490 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 162/326] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:32 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:32.853415 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2aa0e86d-b531-4855-b723-585bf405cd2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "POST /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/action" status: 202 len: 0 microversion: 2.20 time: 9.227626 Jul 21 06:32:32.854092 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 165/327] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jul 21 06:32:23 2022] POST /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/action => generated 0 bytes in 9229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:32:32.862793 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c8af13a0-b81c-4aef-ac6f-d909f2ed644e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:32.863981 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c8af13a0-b81c-4aef-ac6f-d909f2ed644e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:32.872091 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c8af13a0-b81c-4aef-ac6f-d909f2ed644e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:32.872650 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c8af13a0-b81c-4aef-ac6f-d909f2ed644e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:32.873784 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c8af13a0-b81c-4aef-ac6f-d909f2ed644e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:32.874341 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c8af13a0-b81c-4aef-ac6f-d909f2ed644e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:33.239043 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c8af13a0-b81c-4aef-ac6f-d909f2ed644e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:33.247413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c8af13a0-b81c-4aef-ac6f-d909f2ed644e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:33.248994 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c8af13a0-b81c-4aef-ac6f-d909f2ed644e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:33.250255 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c8af13a0-b81c-4aef-ac6f-d909f2ed644e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.391486 Jul 21 06:32:33.250815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 163/328] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:32 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:33.460574 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-20898a30-874c-4050-8f13-0646766d983f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:33.461190 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-20898a30-874c-4050-8f13-0646766d983f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:33.463138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:33.468993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-20898a30-874c-4050-8f13-0646766d983f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:33.469435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-20898a30-874c-4050-8f13-0646766d983f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:33.470220 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-20898a30-874c-4050-8f13-0646766d983f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:33.470652 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-20898a30-874c-4050-8f13-0646766d983f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:33.489061 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:33.605824 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-20898a30-874c-4050-8f13-0646766d983f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:33.613257 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-20898a30-874c-4050-8f13-0646766d983f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.158043 Jul 21 06:32:33.614940 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 166/329] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:33 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:34.270048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-95ceb3a7-63d0-4452-b6a9-cfaac6b8948d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:34.270759 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-95ceb3a7-63d0-4452-b6a9-cfaac6b8948d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:34.277592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95ceb3a7-63d0-4452-b6a9-cfaac6b8948d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:34.278092 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95ceb3a7-63d0-4452-b6a9-cfaac6b8948d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:34.278865 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95ceb3a7-63d0-4452-b6a9-cfaac6b8948d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:34.279304 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-95ceb3a7-63d0-4452-b6a9-cfaac6b8948d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:34.419831 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-95ceb3a7-63d0-4452-b6a9-cfaac6b8948d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:34.428017 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-95ceb3a7-63d0-4452-b6a9-cfaac6b8948d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:34.429525 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-95ceb3a7-63d0-4452-b6a9-cfaac6b8948d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:34.430718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-95ceb3a7-63d0-4452-b6a9-cfaac6b8948d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.164662 Jul 21 06:32:34.431286 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 164/330] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:34 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:34.631259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dfcfde21-1e63-49ed-8fde-16bc6a8531ac tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:34.631918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dfcfde21-1e63-49ed-8fde-16bc6a8531ac tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:34.638702 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dfcfde21-1e63-49ed-8fde-16bc6a8531ac tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:34.639371 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dfcfde21-1e63-49ed-8fde-16bc6a8531ac tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:34.640318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dfcfde21-1e63-49ed-8fde-16bc6a8531ac tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:34.640914 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dfcfde21-1e63-49ed-8fde-16bc6a8531ac tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:34.792409 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dfcfde21-1e63-49ed-8fde-16bc6a8531ac tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:34.801719 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dfcfde21-1e63-49ed-8fde-16bc6a8531ac tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.174358 Jul 21 06:32:34.802651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 167/331] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:34 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:34.919702 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2ae3b433-885d-4ffc-86a0-49fc40477e9e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:34.920114 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2ae3b433-885d-4ffc-86a0-49fc40477e9e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:34.927210 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ae3b433-885d-4ffc-86a0-49fc40477e9e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:34.928433 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ae3b433-885d-4ffc-86a0-49fc40477e9e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:34.929730 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ae3b433-885d-4ffc-86a0-49fc40477e9e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:34.930468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ae3b433-885d-4ffc-86a0-49fc40477e9e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:34.958756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2ae3b433-885d-4ffc-86a0-49fc40477e9e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/ips" status: 200 len: 145 microversion: 2.1 time: 0.043947 Jul 21 06:32:34.959343 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 165/332] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 06:32:34 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:32:35.448669 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-724755a0-f8a7-40ca-9c39-4a0a7e13640b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:35.449438 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-724755a0-f8a7-40ca-9c39-4a0a7e13640b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:35.455938 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-724755a0-f8a7-40ca-9c39-4a0a7e13640b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:35.456410 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-724755a0-f8a7-40ca-9c39-4a0a7e13640b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:35.457746 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-724755a0-f8a7-40ca-9c39-4a0a7e13640b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:35.458398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-724755a0-f8a7-40ca-9c39-4a0a7e13640b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:35.599354 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-724755a0-f8a7-40ca-9c39-4a0a7e13640b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:35.608819 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-724755a0-f8a7-40ca-9c39-4a0a7e13640b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:35.610681 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-724755a0-f8a7-40ca-9c39-4a0a7e13640b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:35.612199 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-724755a0-f8a7-40ca-9c39-4a0a7e13640b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.167442 Jul 21 06:32:35.613245 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 168/333] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:35 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:35.819556 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-047346df-1c14-4b91-b001-6a211d33fd6f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:35.820137 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-047346df-1c14-4b91-b001-6a211d33fd6f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:35.827118 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-047346df-1c14-4b91-b001-6a211d33fd6f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:35.827571 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-047346df-1c14-4b91-b001-6a211d33fd6f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:35.828340 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-047346df-1c14-4b91-b001-6a211d33fd6f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:35.828782 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-047346df-1c14-4b91-b001-6a211d33fd6f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:35.976867 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-047346df-1c14-4b91-b001-6a211d33fd6f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:35.984321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-047346df-1c14-4b91-b001-6a211d33fd6f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1503 microversion: 2.1 time: 0.169379 Jul 21 06:32:35.984881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 166/334] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:35 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:36.001001 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-219ef676-e2bb-470c-bc69-8c8b07e19f6c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4443b2bd-e691-4a18-83d6-6562a911c49d"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:36.002159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-219ef676-e2bb-470c-bc69-8c8b07e19f6c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:36.009151 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-219ef676-e2bb-470c-bc69-8c8b07e19f6c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:36.009866 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-219ef676-e2bb-470c-bc69-8c8b07e19f6c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:36.010678 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-219ef676-e2bb-470c-bc69-8c8b07e19f6c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:36.011119 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-219ef676-e2bb-470c-bc69-8c8b07e19f6c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:36.041541 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-219ef676-e2bb-470c-bc69-8c8b07e19f6c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] HTTP exception thrown: Cannot 'attach_volume' instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 while it is in vm_state rescued Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-219ef676-e2bb-470c-bc69-8c8b07e19f6c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Request method failure captured: Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: POST /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3/os-volume_attachments HTTP/1.1 Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 74 Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PJ-FFa9px1qCFnQ_sVPIFJANLwiQsrfzGqBK9nRcF_7iLo1GNYjYZxw0dARm7jCwmHAsciC1YM2eh222mYLJQw7VTxzlGyzWumMt_LTTamWiA7oArJUmVZuWCK9D7wzeppFw1Lud6bU_EHLtCwlZMUAtguGU1smt37yBYtT3R5G4sQ Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 9cd8a1a642a24b519aefdde9ed336536 Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:32:36.043837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9cd8a1a642a24b519aefdde9ed336536"}]}] Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 9cd8a1a642a24b519aefdde9ed336536 Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-ServerRescueNegativeTestJSON-1302720953-project Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 774dd66c674a4955a439afd30354efab Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1302720953-project Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {"volumeAttachment": {"volumeId": "4443b2bd-e691-4a18-83d6-6562a911c49d"}} Jul 21 06:32:36.045549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Cannot 'attach_volume' instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 while it is in vm_state rescued Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'server_id': '746e5366-e38d-4694-b0dc-5d71af0c69d3', 'body': {'volumeAttachment': {'volumeId': '4443b2bd-e691-4a18-83d6-6562a911c49d'}}} Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:32:36.046568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 while it is in vm_state rescued Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:32:36.047871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:32:36.049428 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:32:36.049428 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:32:36.049428 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 while it is in vm_state rescued Jul 21 06:32:36.049428 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:32:36.049428 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-219ef676-e2bb-470c-bc69-8c8b07e19f6c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Returning 409 to user: Cannot 'attach_volume' instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 while it is in vm_state rescued {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:32:36.049428 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-219ef676-e2bb-470c-bc69-8c8b07e19f6c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048621 Jul 21 06:32:36.052190 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 169/335] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:32:35 2022] POST /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 06:32:36.055389 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9b50fe45-173a-4dc5-bb61-b9fef66fe5b8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:36.055938 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9b50fe45-173a-4dc5-bb61-b9fef66fe5b8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:36.062376 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9b50fe45-173a-4dc5-bb61-b9fef66fe5b8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:36.062802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9b50fe45-173a-4dc5-bb61-b9fef66fe5b8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:36.063622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9b50fe45-173a-4dc5-bb61-b9fef66fe5b8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:36.064058 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9b50fe45-173a-4dc5-bb61-b9fef66fe5b8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:36.120988 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:36.203939 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9b50fe45-173a-4dc5-bb61-b9fef66fe5b8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3/action" status: 202 len: 0 microversion: 2.1 time: 0.152575 Jul 21 06:32:36.205809 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 167/336] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:32:36 2022] POST /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:32:36.215737 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ef41e54b-f600-4789-a1fb-6076501f45c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:36.216364 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ef41e54b-f600-4789-a1fb-6076501f45c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:36.225193 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef41e54b-f600-4789-a1fb-6076501f45c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:36.226050 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef41e54b-f600-4789-a1fb-6076501f45c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:36.227280 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef41e54b-f600-4789-a1fb-6076501f45c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:36.227967 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef41e54b-f600-4789-a1fb-6076501f45c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:36.505848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ef41e54b-f600-4789-a1fb-6076501f45c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:36.549003 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ef41e54b-f600-4789-a1fb-6076501f45c3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1511 microversion: 2.1 time: 0.329471 Jul 21 06:32:36.559477 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 170/337] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:36 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:36.634920 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b6f51de2-7773-43d6-8403-2412937dc192 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:36.635593 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b6f51de2-7773-43d6-8403-2412937dc192 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:36.649666 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b6f51de2-7773-43d6-8403-2412937dc192 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:36.650539 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b6f51de2-7773-43d6-8403-2412937dc192 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:36.659436 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b6f51de2-7773-43d6-8403-2412937dc192 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:36.661356 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b6f51de2-7773-43d6-8403-2412937dc192 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:36.937917 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-cadfb9b4-8303-447b-a462-a9715eac5f3f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:36.941082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-cadfb9b4-8303-447b-a462-a9715eac5f3f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:36.950262 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cadfb9b4-8303-447b-a462-a9715eac5f3f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:36.950783 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cadfb9b4-8303-447b-a462-a9715eac5f3f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:36.953159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cadfb9b4-8303-447b-a462-a9715eac5f3f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:36.953632 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cadfb9b4-8303-447b-a462-a9715eac5f3f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:36.974903 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b6f51de2-7773-43d6-8403-2412937dc192 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:36.985486 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b6f51de2-7773-43d6-8403-2412937dc192 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:36.988259 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b6f51de2-7773-43d6-8403-2412937dc192 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:36.989267 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-cadfb9b4-8303-447b-a462-a9715eac5f3f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/ips" status: 200 len: 150 microversion: 2.1 time: 0.056272 Jul 21 06:32:36.990306 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b6f51de2-7773-43d6-8403-2412937dc192 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.361658 Jul 21 06:32:37.003119 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 168/338] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:36 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:37.010513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 171/339] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 06:32:36 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/ips => generated 150 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:32:37.567588 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f7d5fee8-c6d6-422c-940c-60d52acae917 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:37.568206 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f7d5fee8-c6d6-422c-940c-60d52acae917 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:37.574204 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f7d5fee8-c6d6-422c-940c-60d52acae917 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:37.574651 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f7d5fee8-c6d6-422c-940c-60d52acae917 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:37.575402 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f7d5fee8-c6d6-422c-940c-60d52acae917 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:37.575833 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f7d5fee8-c6d6-422c-940c-60d52acae917 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:37.706240 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f7d5fee8-c6d6-422c-940c-60d52acae917 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:37.714201 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f7d5fee8-c6d6-422c-940c-60d52acae917 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1511 microversion: 2.1 time: 0.150908 Jul 21 06:32:37.714813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 169/340] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:37 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:37.949600 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ab33a22f-a3c2-45ea-86b4-4c0620c028b0 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e943109-dba9-41ba-84fa-bf832c8cb832"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:37.950710 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ab33a22f-a3c2-45ea-86b4-4c0620c028b0 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:37.956633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ab33a22f-a3c2-45ea-86b4-4c0620c028b0 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:37.957836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ab33a22f-a3c2-45ea-86b4-4c0620c028b0 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:37.958633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ab33a22f-a3c2-45ea-86b4-4c0620c028b0 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:37.959077 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ab33a22f-a3c2-45ea-86b4-4c0620c028b0 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:38.013134 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fb7fdb59-3f42-4fd1-8725-ffda32397f14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:38.014561 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fb7fdb59-3f42-4fd1-8725-ffda32397f14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:38.028949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb7fdb59-3f42-4fd1-8725-ffda32397f14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:38.029499 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb7fdb59-3f42-4fd1-8725-ffda32397f14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:38.030541 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb7fdb59-3f42-4fd1-8725-ffda32397f14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:38.031176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb7fdb59-3f42-4fd1-8725-ffda32397f14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:38.196730 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fb7fdb59-3f42-4fd1-8725-ffda32397f14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:38.205349 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fb7fdb59-3f42-4fd1-8725-ffda32397f14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:38.207396 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fb7fdb59-3f42-4fd1-8725-ffda32397f14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:38.208776 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fb7fdb59-3f42-4fd1-8725-ffda32397f14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.202229 Jul 21 06:32:38.217256 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 170/341] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:38 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:38.732675 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0e924393-50f3-4321-aa2d-9e924f72a47c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:38.733334 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0e924393-50f3-4321-aa2d-9e924f72a47c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:38.739548 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e924393-50f3-4321-aa2d-9e924f72a47c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:38.740000 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e924393-50f3-4321-aa2d-9e924f72a47c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:38.740767 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e924393-50f3-4321-aa2d-9e924f72a47c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:38.741207 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e924393-50f3-4321-aa2d-9e924f72a47c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:38.867842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0e924393-50f3-4321-aa2d-9e924f72a47c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:38.875337 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0e924393-50f3-4321-aa2d-9e924f72a47c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1511 microversion: 2.1 time: 0.146510 Jul 21 06:32:38.875886 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 171/342] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:38 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:39.228751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b5bc1e1b-4f56-4d2e-845e-b05e96c80396 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:39.229511 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b5bc1e1b-4f56-4d2e-845e-b05e96c80396 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:39.235990 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b5bc1e1b-4f56-4d2e-845e-b05e96c80396 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:39.236514 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b5bc1e1b-4f56-4d2e-845e-b05e96c80396 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:39.237503 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b5bc1e1b-4f56-4d2e-845e-b05e96c80396 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:39.238067 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b5bc1e1b-4f56-4d2e-845e-b05e96c80396 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:39.379952 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b5bc1e1b-4f56-4d2e-845e-b05e96c80396 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:39.388288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b5bc1e1b-4f56-4d2e-845e-b05e96c80396 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:39.389803 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b5bc1e1b-4f56-4d2e-845e-b05e96c80396 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:39.390998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b5bc1e1b-4f56-4d2e-845e-b05e96c80396 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.166258 Jul 21 06:32:39.391905 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 172/343] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:39 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:32:39.455925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a708b79d-916f-4808-9ca6-a3df28a11404 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54a2284c-0453-4c14-852c-c9fb62554395"}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:39.457211 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a708b79d-916f-4808-9ca6-a3df28a11404 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:39.463642 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a708b79d-916f-4808-9ca6-a3df28a11404 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:39.464561 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a708b79d-916f-4808-9ca6-a3df28a11404 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:39.466245 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a708b79d-916f-4808-9ca6-a3df28a11404 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:39.466391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a708b79d-916f-4808-9ca6-a3df28a11404 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:39.792089 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ab33a22f-a3c2-45ea-86b4-4c0620c028b0 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.846345 Jul 21 06:32:39.797859 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 172/344] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:32:37 2022] POST /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/os-volume_attachments => generated 194 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:32:39.901122 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-73c54174-9019-4c06-bf38-38ca92a6e187 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:39.902126 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-73c54174-9019-4c06-bf38-38ca92a6e187 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:39.921437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73c54174-9019-4c06-bf38-38ca92a6e187 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:39.921891 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73c54174-9019-4c06-bf38-38ca92a6e187 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:39.929211 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73c54174-9019-4c06-bf38-38ca92a6e187 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:39.929739 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73c54174-9019-4c06-bf38-38ca92a6e187 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:39.947228 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a708b79d-916f-4808-9ca6-a3df28a11404 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490601 Jul 21 06:32:39.953563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 173/345] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:32:39 2022] POST /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:32:40.168893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-73c54174-9019-4c06-bf38-38ca92a6e187 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:40.177775 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-73c54174-9019-4c06-bf38-38ca92a6e187 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1511 microversion: 2.1 time: 0.287906 Jul 21 06:32:40.178382 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 173/346] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:39 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:40.414107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-076e9036-5f32-4b3c-bdfa-ed33432b33d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:40.414717 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-076e9036-5f32-4b3c-bdfa-ed33432b33d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:40.421233 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-076e9036-5f32-4b3c-bdfa-ed33432b33d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:40.421683 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-076e9036-5f32-4b3c-bdfa-ed33432b33d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:40.422584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-076e9036-5f32-4b3c-bdfa-ed33432b33d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:40.423017 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-076e9036-5f32-4b3c-bdfa-ed33432b33d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:40.587054 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-076e9036-5f32-4b3c-bdfa-ed33432b33d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:40.595496 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-076e9036-5f32-4b3c-bdfa-ed33432b33d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:40.597243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-076e9036-5f32-4b3c-bdfa-ed33432b33d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:40.599324 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-076e9036-5f32-4b3c-bdfa-ed33432b33d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.191587 Jul 21 06:32:40.599890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 174/347] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:40 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:41.195873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2da7d176-c6aa-4b2e-88eb-2c54a86996bf tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:41.196408 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2da7d176-c6aa-4b2e-88eb-2c54a86996bf tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:41.206893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2da7d176-c6aa-4b2e-88eb-2c54a86996bf tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:41.208335 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2da7d176-c6aa-4b2e-88eb-2c54a86996bf tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:41.209144 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2da7d176-c6aa-4b2e-88eb-2c54a86996bf tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:41.209584 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2da7d176-c6aa-4b2e-88eb-2c54a86996bf tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:41.278637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1076993888", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1128193888", "security_groups": [{"name": "tempest-secgroup-smoke-771985638"}], "block_device_mapping_v2": [{"uuid": "0ab52c86-8cd7-4179-89fa-9ce0fc73ff47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dadad058-4314-4199-8e9f-a1bda80f561d"}]}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:41.405376 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2da7d176-c6aa-4b2e-88eb-2c54a86996bf tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:41.415099 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2da7d176-c6aa-4b2e-88eb-2c54a86996bf tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1517 microversion: 2.1 time: 0.224134 Jul 21 06:32:41.429508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 174/348] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:41 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:41.445272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.network.neutron [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] validate_networks() for [('dadad058-4314-4199-8e9f-a1bda80f561d', None, None, None, None, None)] {{(pid=117905) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:32:41.619825 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-278a68a9-f127-4481-b2c1-4a410a4bc48a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:41.620434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-278a68a9-f127-4481-b2c1-4a410a4bc48a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:41.630057 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-278a68a9-f127-4481-b2c1-4a410a4bc48a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:41.630864 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-278a68a9-f127-4481-b2c1-4a410a4bc48a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:41.631822 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-278a68a9-f127-4481-b2c1-4a410a4bc48a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:41.632416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-278a68a9-f127-4481-b2c1-4a410a4bc48a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:41.898708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-278a68a9-f127-4481-b2c1-4a410a4bc48a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:41.912399 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-278a68a9-f127-4481-b2c1-4a410a4bc48a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:41.914410 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-278a68a9-f127-4481-b2c1-4a410a4bc48a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:41.919425 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-278a68a9-f127-4481-b2c1-4a410a4bc48a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.303230 Jul 21 06:32:41.920275 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 175/349] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:41 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:32:42.021358 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Flavor limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:32:42.021788 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Image limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:32:42.022334 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Flavor pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:32:42.022752 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Image pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:32:42.023169 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:32:42.036047 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:42.036784 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:42.037599 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:42.038070 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:42.062467 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Getting quotas for project 5d0ba27e9a7f450c87eb189cdd6e235b. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:32:42.067134 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Getting quotas for user 5439d1a65154486bb4fdfeeaf8ab4b07 and project 5d0ba27e9a7f450c87eb189cdd6e235b. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:32:42.147110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Going to run 1 instances... {{(pid=117905) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:32:42.149482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ab52c86-8cd7-4179-89fa-9ce0fc73ff47',volume_size=None,volume_type=None)] {{(pid=117905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:32:42.276278 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d2725e1d-26e3-4733-96cb-f7c0b4a7e00d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.001940 Jul 21 06:32:42.276932 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 175/350] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:32:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 06:32:42.287467 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b895f61e-9a62-46ee-8661-05448183ce81 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:42.288014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b895f61e-9a62-46ee-8661-05448183ce81 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:42.340302 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b895f61e-9a62-46ee-8661-05448183ce81 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:42.346922 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b895f61e-9a62-46ee-8661-05448183ce81 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1095 microversion: 2.1 time: 0.064045 Jul 21 06:32:42.348040 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 176/351] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:42 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:42.938815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1704133a-50c4-4ab3-a896-d0d2b82dcfab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:42.939425 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1704133a-50c4-4ab3-a896-d0d2b82dcfab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:42.946749 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1704133a-50c4-4ab3-a896-d0d2b82dcfab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:42.947198 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1704133a-50c4-4ab3-a896-d0d2b82dcfab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:42.947951 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1704133a-50c4-4ab3-a896-d0d2b82dcfab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:42.948387 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1704133a-50c4-4ab3-a896-d0d2b82dcfab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:43.073695 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1704133a-50c4-4ab3-a896-d0d2b82dcfab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:43.081967 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1704133a-50c4-4ab3-a896-d0d2b82dcfab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:43.083627 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1704133a-50c4-4ab3-a896-d0d2b82dcfab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:43.084771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1704133a-50c4-4ab3-a896-d0d2b82dcfab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.150356 Jul 21 06:32:43.085331 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 176/352] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:42 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:43.365065 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ba0a46e7-685b-4425-bdc9-67f9ea7af786 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:43.365576 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ba0a46e7-685b-4425-bdc9-67f9ea7af786 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:43.372599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ba0a46e7-685b-4425-bdc9-67f9ea7af786 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:43.373052 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ba0a46e7-685b-4425-bdc9-67f9ea7af786 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:43.373809 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ba0a46e7-685b-4425-bdc9-67f9ea7af786 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:43.374269 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ba0a46e7-685b-4425-bdc9-67f9ea7af786 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:43.436365 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ba0a46e7-685b-4425-bdc9-67f9ea7af786 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:43.443848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ba0a46e7-685b-4425-bdc9-67f9ea7af786 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1145 microversion: 2.1 time: 0.083366 Jul 21 06:32:43.444410 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 177/353] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:43 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:44.103296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-42742db1-73ab-4328-8055-8e1317b66a16 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:44.104531 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-42742db1-73ab-4328-8055-8e1317b66a16 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:44.112002 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-42742db1-73ab-4328-8055-8e1317b66a16 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:44.112757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-42742db1-73ab-4328-8055-8e1317b66a16 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:44.114655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-42742db1-73ab-4328-8055-8e1317b66a16 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:44.115247 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-42742db1-73ab-4328-8055-8e1317b66a16 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:44.286737 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-42742db1-73ab-4328-8055-8e1317b66a16 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:44.298313 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-42742db1-73ab-4328-8055-8e1317b66a16 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:44.299848 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-42742db1-73ab-4328-8055-8e1317b66a16 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:44.301236 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-42742db1-73ab-4328-8055-8e1317b66a16 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.201971 Jul 21 06:32:44.302180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 177/354] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:44 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:32:44.461609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dd277697-2c8d-4bb4-b401-4f8c783dfdc0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:44.462323 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dd277697-2c8d-4bb4-b401-4f8c783dfdc0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:44.469638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd277697-2c8d-4bb4-b401-4f8c783dfdc0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:44.470123 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd277697-2c8d-4bb4-b401-4f8c783dfdc0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:44.471070 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd277697-2c8d-4bb4-b401-4f8c783dfdc0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:44.471667 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd277697-2c8d-4bb4-b401-4f8c783dfdc0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:44.575025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dd277697-2c8d-4bb4-b401-4f8c783dfdc0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:44.587282 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dd277697-2c8d-4bb4-b401-4f8c783dfdc0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1211 microversion: 2.1 time: 0.130365 Jul 21 06:32:44.588258 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 178/355] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:44 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:45.329262 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5bcb7205-476a-4a90-9b99-36322b7361e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:45.330005 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5bcb7205-476a-4a90-9b99-36322b7361e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:45.343868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5bcb7205-476a-4a90-9b99-36322b7361e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:45.344483 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5bcb7205-476a-4a90-9b99-36322b7361e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:45.352175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5bcb7205-476a-4a90-9b99-36322b7361e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:45.353351 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5bcb7205-476a-4a90-9b99-36322b7361e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:45.608813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-76c3e55e-e2e8-47b5-8d7b-b6df8cb70049 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:45.610119 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-76c3e55e-e2e8-47b5-8d7b-b6df8cb70049 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:45.625117 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76c3e55e-e2e8-47b5-8d7b-b6df8cb70049 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:45.626812 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76c3e55e-e2e8-47b5-8d7b-b6df8cb70049 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:45.628131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76c3e55e-e2e8-47b5-8d7b-b6df8cb70049 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:45.630369 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76c3e55e-e2e8-47b5-8d7b-b6df8cb70049 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:45.644483 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5bcb7205-476a-4a90-9b99-36322b7361e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:45.656948 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5bcb7205-476a-4a90-9b99-36322b7361e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:45.660794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5bcb7205-476a-4a90-9b99-36322b7361e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:45.662298 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5bcb7205-476a-4a90-9b99-36322b7361e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.343795 Jul 21 06:32:45.663097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 178/356] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:45 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:45.882535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-76c3e55e-e2e8-47b5-8d7b-b6df8cb70049 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:45.912853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-76c3e55e-e2e8-47b5-8d7b-b6df8cb70049 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.309298 Jul 21 06:32:45.918365 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 179/357] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:45 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:46.117969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-691aea4f-d4de-4ef5-af7b-2da2fefad3db tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'create', calling method: .version_select at 0x7f9327ce91f0>, body: {"keypair": {"name": "tempest-keypair-1170762651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBZXn70dNWxG9OmXjyg6+KNzAToMM3tJlg2ky5cTvqUOsUxLhxFZ06a102/988Zo4UZbkJ9hOO/hlpuXeJGQUxyphOYjaauvBrYkH4Exujjd/4bsQldVpnPIPUx5hjRVw=="}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:46.122941 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-aa781c87-0e9d-4b1d-b684-19e34ad67ee1 req-d7e47e9c-96b6-4ef2-9731-718f6da71fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd12a96-a6ba-4881-9e69-20771a9b2d91", "tag": "30a8386c-e7fc-4d12-86c3-922716884c6e"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:46.141690 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-aa781c87-0e9d-4b1d-b684-19e34ad67ee1 req-d7e47e9c-96b6-4ef2-9731-718f6da71fab service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:46.158249 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-aa781c87-0e9d-4b1d-b684-19e34ad67ee1 req-d7e47e9c-96b6-4ef2-9731-718f6da71fab service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:46.165051 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-691aea4f-d4de-4ef5-af7b-2da2fefad3db tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Getting quotas for project 9cd8a1a642a24b519aefdde9ed336536. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:32:46.170364 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-691aea4f-d4de-4ef5-af7b-2da2fefad3db tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Getting quotas for user 774dd66c674a4955a439afd30354efab and project 9cd8a1a642a24b519aefdde9ed336536. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:32:46.172922 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-aa781c87-0e9d-4b1d-b684-19e34ad67ee1 req-d7e47e9c-96b6-4ef2-9731-718f6da71fab service nova] Creating event network-changed:30a8386c-e7fc-4d12-86c3-922716884c6e for instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 on hv-cinder-85031 Jul 21 06:32:46.178675 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-aa781c87-0e9d-4b1d-b684-19e34ad67ee1 req-d7e47e9c-96b6-4ef2-9731-718f6da71fab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066645 Jul 21 06:32:46.190189 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 179/358] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:32:46.220226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-691aea4f-d4de-4ef5-af7b-2da2fefad3db tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108089 Jul 21 06:32:46.221454 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 180/359] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 06:32:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:32:46.683467 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d712e663-944a-49ed-9f11-33ce94246070 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:46.685056 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d712e663-944a-49ed-9f11-33ce94246070 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:46.715879 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d712e663-944a-49ed-9f11-33ce94246070 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:46.716718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d712e663-944a-49ed-9f11-33ce94246070 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:46.717737 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d712e663-944a-49ed-9f11-33ce94246070 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:46.718390 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d712e663-944a-49ed-9f11-33ce94246070 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:46.936346 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5611c86b-4a52-4188-9028-3ae86e808820 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:46.937263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5611c86b-4a52-4188-9028-3ae86e808820 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:46.946406 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5611c86b-4a52-4188-9028-3ae86e808820 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:46.946873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5611c86b-4a52-4188-9028-3ae86e808820 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:46.951261 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5611c86b-4a52-4188-9028-3ae86e808820 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:46.951921 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5611c86b-4a52-4188-9028-3ae86e808820 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:46.982765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d712e663-944a-49ed-9f11-33ce94246070 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:46.993027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d712e663-944a-49ed-9f11-33ce94246070 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:46.995226 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d712e663-944a-49ed-9f11-33ce94246070 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:46.996617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d712e663-944a-49ed-9f11-33ce94246070 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.319410 Jul 21 06:32:46.997398 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 180/360] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:46 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:47.683012 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5611c86b-4a52-4188-9028-3ae86e808820 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:47.696535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5611c86b-4a52-4188-9028-3ae86e808820 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.765798 Jul 21 06:32:47.697565 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 181/361] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:46 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:48.016308 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3b6fa54f-36f5-44b0-8a93-f3f197e09a01 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:48.016933 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3b6fa54f-36f5-44b0-8a93-f3f197e09a01 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:48.021763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:48.032025 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3b6fa54f-36f5-44b0-8a93-f3f197e09a01 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:48.032423 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3b6fa54f-36f5-44b0-8a93-f3f197e09a01 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:48.033614 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3b6fa54f-36f5-44b0-8a93-f3f197e09a01 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:48.038558 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3b6fa54f-36f5-44b0-8a93-f3f197e09a01 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:48.227910 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3b6fa54f-36f5-44b0-8a93-f3f197e09a01 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:48.235935 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3b6fa54f-36f5-44b0-8a93-f3f197e09a01 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:48.237596 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3b6fa54f-36f5-44b0-8a93-f3f197e09a01 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:48.240058 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3b6fa54f-36f5-44b0-8a93-f3f197e09a01 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.228122 Jul 21 06:32:48.240702 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 181/362] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:48 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:48.250294 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2031396830", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99d9c8f4-68ee-4bd8-aaed-8ace9842a377"}], "security_groups": [{"name": "tempest-securitygroup--454239846"}], "key_name": "tempest-keypair-1170762651", "user_data": "}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:48.353980 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] validate_networks() for [('99d9c8f4-68ee-4bd8-aaed-8ace9842a377', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:32:48.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ad9ec494-e3c6-4503-a323-45839aec5636 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:48.714718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ad9ec494-e3c6-4503-a323-45839aec5636 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:48.720920 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ad9ec494-e3c6-4503-a323-45839aec5636 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:48.721366 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ad9ec494-e3c6-4503-a323-45839aec5636 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:48.722169 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ad9ec494-e3c6-4503-a323-45839aec5636 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:48.723361 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ad9ec494-e3c6-4503-a323-45839aec5636 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:48.731791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:32:48.732231 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:32:48.732699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:32:48.733113 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:32:48.733534 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:32:48.744344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:48.745127 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:48.746337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:48.747222 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:48.764856 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Getting quotas for project 9cd8a1a642a24b519aefdde9ed336536. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:32:48.768860 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Getting quotas for user 774dd66c674a4955a439afd30354efab and project 9cd8a1a642a24b519aefdde9ed336536. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:32:48.783885 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:32:48.787137 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:32:48.837386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e6f3e8fd-f59f-4c3a-9436-15726652bf51 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.591821 Jul 21 06:32:48.838230 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 182/363] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:32:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 06:32:48.848373 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1561953b-95fc-40bc-a441-ccd2514d9fde tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:48.849088 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1561953b-95fc-40bc-a441-ccd2514d9fde tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:48.867374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ad9ec494-e3c6-4503-a323-45839aec5636 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:48.875835 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ad9ec494-e3c6-4503-a323-45839aec5636 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.166249 Jul 21 06:32:48.876494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 182/364] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:48 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:48.905640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1561953b-95fc-40bc-a441-ccd2514d9fde tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:48.912678 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1561953b-95fc-40bc-a441-ccd2514d9fde tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1246 microversion: 2.1 time: 0.068360 Jul 21 06:32:48.913251 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 183/365] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:48 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:49.261652 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-570749d2-ae8d-426c-867e-a517a6b9e379 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:49.262352 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-570749d2-ae8d-426c-867e-a517a6b9e379 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:49.268841 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-570749d2-ae8d-426c-867e-a517a6b9e379 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:49.269290 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-570749d2-ae8d-426c-867e-a517a6b9e379 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:49.270110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-570749d2-ae8d-426c-867e-a517a6b9e379 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:49.270629 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-570749d2-ae8d-426c-867e-a517a6b9e379 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:49.446516 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-570749d2-ae8d-426c-867e-a517a6b9e379 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:49.459539 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-570749d2-ae8d-426c-867e-a517a6b9e379 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:49.461526 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-570749d2-ae8d-426c-867e-a517a6b9e379 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:49.463035 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-570749d2-ae8d-426c-867e-a517a6b9e379 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.205691 Jul 21 06:32:49.463989 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 183/366] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:49 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:49.893567 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4f9d3055-46e4-496b-bda2-7e4d231b492a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:49.894206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4f9d3055-46e4-496b-bda2-7e4d231b492a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:49.901423 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4f9d3055-46e4-496b-bda2-7e4d231b492a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:49.902115 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4f9d3055-46e4-496b-bda2-7e4d231b492a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:49.902892 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4f9d3055-46e4-496b-bda2-7e4d231b492a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:49.903335 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4f9d3055-46e4-496b-bda2-7e4d231b492a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:49.930148 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6970a7d0-45f6-48f0-8be9-53ca18644cdc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:49.930758 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6970a7d0-45f6-48f0-8be9-53ca18644cdc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:49.936991 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6970a7d0-45f6-48f0-8be9-53ca18644cdc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:49.937441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6970a7d0-45f6-48f0-8be9-53ca18644cdc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:49.938235 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6970a7d0-45f6-48f0-8be9-53ca18644cdc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:49.938668 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6970a7d0-45f6-48f0-8be9-53ca18644cdc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:49.943898 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:50.024190 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6970a7d0-45f6-48f0-8be9-53ca18644cdc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:50.031839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6970a7d0-45f6-48f0-8be9-53ca18644cdc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1298 microversion: 2.1 time: 0.106622 Jul 21 06:32:50.032673 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 184/367] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:49 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:50.068401 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-4f9d3055-46e4-496b-bda2-7e4d231b492a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:50.075892 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4f9d3055-46e4-496b-bda2-7e4d231b492a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.186198 Jul 21 06:32:50.076452 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 184/368] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:49 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:50.480648 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-004c854d-8448-4be0-b00d-d639366f340d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:50.481260 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-004c854d-8448-4be0-b00d-d639366f340d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:50.487648 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-004c854d-8448-4be0-b00d-d639366f340d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:50.488118 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-004c854d-8448-4be0-b00d-d639366f340d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:50.489461 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-004c854d-8448-4be0-b00d-d639366f340d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:50.489895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-004c854d-8448-4be0-b00d-d639366f340d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:50.621812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-004c854d-8448-4be0-b00d-d639366f340d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:50.630347 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-004c854d-8448-4be0-b00d-d639366f340d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:50.631836 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-004c854d-8448-4be0-b00d-d639366f340d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:50.632987 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-004c854d-8448-4be0-b00d-d639366f340d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1746 microversion: 2.20 time: 0.156227 Jul 21 06:32:50.633549 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 185/369] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:50 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:51.048561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-fde6a55e-18c7-4378-bd58-085f5b43700b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:51.049101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-fde6a55e-18c7-4378-bd58-085f5b43700b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:51.056358 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fde6a55e-18c7-4378-bd58-085f5b43700b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:51.056807 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fde6a55e-18c7-4378-bd58-085f5b43700b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:51.057570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fde6a55e-18c7-4378-bd58-085f5b43700b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:51.058479 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fde6a55e-18c7-4378-bd58-085f5b43700b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:51.092306 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9ad275df-0aa0-4119-ba75-032220c1cf68 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:51.092915 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9ad275df-0aa0-4119-ba75-032220c1cf68 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:51.100239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9ad275df-0aa0-4119-ba75-032220c1cf68 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:51.100695 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9ad275df-0aa0-4119-ba75-032220c1cf68 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:51.101460 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9ad275df-0aa0-4119-ba75-032220c1cf68 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:51.101891 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9ad275df-0aa0-4119-ba75-032220c1cf68 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:51.118958 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fde6a55e-18c7-4378-bd58-085f5b43700b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:51.126196 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-fde6a55e-18c7-4378-bd58-085f5b43700b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1306 microversion: 2.1 time: 0.081508 Jul 21 06:32:51.126796 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 185/370] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:51 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1306 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:51.231076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9ad275df-0aa0-4119-ba75-032220c1cf68 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:51.239218 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9ad275df-0aa0-4119-ba75-032220c1cf68 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.150112 Jul 21 06:32:51.240230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 186/371] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:51 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:51.651648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-10c9091c-204c-42de-9cad-802ec886df06 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:51.652248 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-10c9091c-204c-42de-9cad-802ec886df06 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:51.658296 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10c9091c-204c-42de-9cad-802ec886df06 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:51.658739 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10c9091c-204c-42de-9cad-802ec886df06 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:51.659489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10c9091c-204c-42de-9cad-802ec886df06 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:51.659920 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10c9091c-204c-42de-9cad-802ec886df06 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:51.664510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:51.792627 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-10c9091c-204c-42de-9cad-802ec886df06 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:51.800357 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-10c9091c-204c-42de-9cad-802ec886df06 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:51.803305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-10c9091c-204c-42de-9cad-802ec886df06 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:51.804499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-10c9091c-204c-42de-9cad-802ec886df06 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1746 microversion: 2.20 time: 0.156928 Jul 21 06:32:51.805058 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 186/372] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:51 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:52.143176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-cc5a4843-5e37-4bc5-bd64-2da2a5db9c3b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:52.143782 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-cc5a4843-5e37-4bc5-bd64-2da2a5db9c3b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:52.146163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:52.146817 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=6 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:52.153280 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc5a4843-5e37-4bc5-bd64-2da2a5db9c3b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:52.153721 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc5a4843-5e37-4bc5-bd64-2da2a5db9c3b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:52.154508 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc5a4843-5e37-4bc5-bd64-2da2a5db9c3b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:52.154941 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc5a4843-5e37-4bc5-bd64-2da2a5db9c3b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:52.215910 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-cc5a4843-5e37-4bc5-bd64-2da2a5db9c3b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:52.223356 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-cc5a4843-5e37-4bc5-bd64-2da2a5db9c3b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1306 microversion: 2.1 time: 0.083870 Jul 21 06:32:52.223930 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 187/373] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:52 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1306 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:52.256613 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7ed35e60-4fb9-47ba-806f-6ebda81240cb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:52.257227 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7ed35e60-4fb9-47ba-806f-6ebda81240cb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:52.263737 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7ed35e60-4fb9-47ba-806f-6ebda81240cb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:52.264190 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7ed35e60-4fb9-47ba-806f-6ebda81240cb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:52.264956 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7ed35e60-4fb9-47ba-806f-6ebda81240cb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:52.265398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7ed35e60-4fb9-47ba-806f-6ebda81240cb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:52.392511 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7ed35e60-4fb9-47ba-806f-6ebda81240cb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:52.400223 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7ed35e60-4fb9-47ba-806f-6ebda81240cb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.148091 Jul 21 06:32:52.400791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 187/374] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:52 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:52.822476 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f4b02acc-5193-4a1d-85c8-454f6830b019 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:52.823093 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f4b02acc-5193-4a1d-85c8-454f6830b019 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:52.829090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f4b02acc-5193-4a1d-85c8-454f6830b019 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:52.829542 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f4b02acc-5193-4a1d-85c8-454f6830b019 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:52.830337 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f4b02acc-5193-4a1d-85c8-454f6830b019 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:52.830781 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f4b02acc-5193-4a1d-85c8-454f6830b019 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:52.970542 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f4b02acc-5193-4a1d-85c8-454f6830b019 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:52.982129 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f4b02acc-5193-4a1d-85c8-454f6830b019 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:52.982129 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f4b02acc-5193-4a1d-85c8-454f6830b019 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:52.983173 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f4b02acc-5193-4a1d-85c8-454f6830b019 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1746 microversion: 2.20 time: 0.164559 Jul 21 06:32:52.983723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 188/375] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:52 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:53.240483 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-62e569d4-b80b-4381-84d9-acaf8ca3b7e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:53.241215 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-62e569d4-b80b-4381-84d9-acaf8ca3b7e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:53.247617 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-62e569d4-b80b-4381-84d9-acaf8ca3b7e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:53.248142 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-62e569d4-b80b-4381-84d9-acaf8ca3b7e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:53.249017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-62e569d4-b80b-4381-84d9-acaf8ca3b7e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:53.249458 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-62e569d4-b80b-4381-84d9-acaf8ca3b7e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:53.315420 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-62e569d4-b80b-4381-84d9-acaf8ca3b7e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:53.324073 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-62e569d4-b80b-4381-84d9-acaf8ca3b7e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1316 microversion: 2.1 time: 0.087681 Jul 21 06:32:53.324654 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 188/376] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:53 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1316 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:53.416633 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2d20bd99-195a-4413-b3a4-5285708c0866 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:53.417192 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2d20bd99-195a-4413-b3a4-5285708c0866 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:53.423737 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d20bd99-195a-4413-b3a4-5285708c0866 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:53.424190 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d20bd99-195a-4413-b3a4-5285708c0866 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:53.424960 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d20bd99-195a-4413-b3a4-5285708c0866 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:53.425399 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d20bd99-195a-4413-b3a4-5285708c0866 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:53.563488 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2d20bd99-195a-4413-b3a4-5285708c0866 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:53.572603 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2d20bd99-195a-4413-b3a4-5285708c0866 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.159836 Jul 21 06:32:53.573236 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 189/377] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:53 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:54.004755 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-18be2abe-d96e-4a21-9eec-4a6eb078065a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:54.005509 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-18be2abe-d96e-4a21-9eec-4a6eb078065a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:54.012360 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18be2abe-d96e-4a21-9eec-4a6eb078065a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:54.013188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18be2abe-d96e-4a21-9eec-4a6eb078065a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:54.014202 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18be2abe-d96e-4a21-9eec-4a6eb078065a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:54.014848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18be2abe-d96e-4a21-9eec-4a6eb078065a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:54.273346 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-af12caf7-bd3a-40f9-aa43-a75b3ab6c84b req-cc89a99c-3257-477d-862a-23ac80e8a3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40d32b1-a161-49f9-a2ae-fe794e9a66cd", "name": "network-vif-plugged", "status": "completed", "tag": "345fc32c-f55c-4636-be16-4b276cd0c105"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:54.293196 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-af12caf7-bd3a-40f9-aa43-a75b3ab6c84b req-cc89a99c-3257-477d-862a-23ac80e8a3ca service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:54.293630 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-af12caf7-bd3a-40f9-aa43-a75b3ab6c84b req-cc89a99c-3257-477d-862a-23ac80e8a3ca service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:54.310392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-af12caf7-bd3a-40f9-aa43-a75b3ab6c84b req-cc89a99c-3257-477d-862a-23ac80e8a3ca service nova] Creating event network-vif-plugged:345fc32c-f55c-4636-be16-4b276cd0c105 for instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd on hv-cinder-85031 Jul 21 06:32:54.315012 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-af12caf7-bd3a-40f9-aa43-a75b3ab6c84b req-cc89a99c-3257-477d-862a-23ac80e8a3ca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047562 Jul 21 06:32:54.316726 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 190/378] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:32:54.345006 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-955d5891-f866-4063-9f4f-6a58accd31a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:54.346183 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-955d5891-f866-4063-9f4f-6a58accd31a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:54.354908 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-955d5891-f866-4063-9f4f-6a58accd31a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:54.355445 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-955d5891-f866-4063-9f4f-6a58accd31a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:54.356672 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-955d5891-f866-4063-9f4f-6a58accd31a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:54.357479 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-955d5891-f866-4063-9f4f-6a58accd31a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:54.425987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-18be2abe-d96e-4a21-9eec-4a6eb078065a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:54.436857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-18be2abe-d96e-4a21-9eec-4a6eb078065a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:54.438422 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-18be2abe-d96e-4a21-9eec-4a6eb078065a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:54.448670 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-18be2abe-d96e-4a21-9eec-4a6eb078065a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1746 microversion: 2.20 time: 0.443073 Jul 21 06:32:54.449449 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 189/379] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:53 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1746 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:54.589654 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-49cd3076-16b5-4813-93dc-8182a8a768fa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:54.590638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-49cd3076-16b5-4813-93dc-8182a8a768fa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:54.600277 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49cd3076-16b5-4813-93dc-8182a8a768fa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:54.601040 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49cd3076-16b5-4813-93dc-8182a8a768fa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:54.601836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49cd3076-16b5-4813-93dc-8182a8a768fa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:54.602324 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49cd3076-16b5-4813-93dc-8182a8a768fa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:54.723457 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-955d5891-f866-4063-9f4f-6a58accd31a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:54.740774 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-955d5891-f866-4063-9f4f-6a58accd31a7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1371 microversion: 2.1 time: 0.402272 Jul 21 06:32:54.741374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 191/380] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:54 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1371 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:54.937081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-49cd3076-16b5-4813-93dc-8182a8a768fa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:54.951637 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-49cd3076-16b5-4813-93dc-8182a8a768fa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.365973 Jul 21 06:32:54.967170 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 190/381] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:54 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:55.241315 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3a321eb3-c248-4a8b-9839-a52262cb1d17 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:55.248779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3a321eb3-c248-4a8b-9839-a52262cb1d17 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:55.249703 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3a321eb3-c248-4a8b-9839-a52262cb1d17 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:55.339556 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3a321eb3-c248-4a8b-9839-a52262cb1d17 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Going to try to stop instance {{(pid=117905) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 06:32:55.423454 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3a321eb3-c248-4a8b-9839-a52262cb1d17 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/action" status: 202 len: 0 microversion: 2.1 time: 0.187378 Jul 21 06:32:55.424860 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 192/382] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:32:55 2022] POST /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:32:55.433327 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a410826c-ca47-4ca6-96da-1d3b89d45b9b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:55.433872 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a410826c-ca47-4ca6-96da-1d3b89d45b9b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:55.444517 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a410826c-ca47-4ca6-96da-1d3b89d45b9b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:55.445364 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a410826c-ca47-4ca6-96da-1d3b89d45b9b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:55.446487 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a410826c-ca47-4ca6-96da-1d3b89d45b9b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:55.447196 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a410826c-ca47-4ca6-96da-1d3b89d45b9b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:55.472795 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f4f901b1-a859-44d6-a759-0dda616d4a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:55.473899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f4f901b1-a859-44d6-a759-0dda616d4a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:55.485798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f4f901b1-a859-44d6-a759-0dda616d4a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:55.486945 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f4f901b1-a859-44d6-a759-0dda616d4a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:55.488529 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f4f901b1-a859-44d6-a759-0dda616d4a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:55.489062 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f4f901b1-a859-44d6-a759-0dda616d4a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:55.861161 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a410826c-ca47-4ca6-96da-1d3b89d45b9b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:55.874328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f4f901b1-a859-44d6-a759-0dda616d4a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:55.882184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a410826c-ca47-4ca6-96da-1d3b89d45b9b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.452426 Jul 21 06:32:55.888226 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f4f901b1-a859-44d6-a759-0dda616d4a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:55.889846 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f4f901b1-a859-44d6-a759-0dda616d4a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:55.891388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 191/383] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:55 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:55.896711 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f4f901b1-a859-44d6-a759-0dda616d4a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1741 microversion: 2.20 time: 0.428735 Jul 21 06:32:55.897812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 193/384] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:55 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1741 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:55.899649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-28eee42c-3eb6-4b86-ab32-d7a4fb690020 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:55.900461 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-28eee42c-3eb6-4b86-ab32-d7a4fb690020 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:55.907043 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-28eee42c-3eb6-4b86-ab32-d7a4fb690020 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:55.907705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-28eee42c-3eb6-4b86-ab32-d7a4fb690020 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:55.908651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-28eee42c-3eb6-4b86-ab32-d7a4fb690020 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:55.909269 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-28eee42c-3eb6-4b86-ab32-d7a4fb690020 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:55.968067 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-336a02e9-cbd7-4c97-a35f-6d586f531d11 req-1d9d0fa9-f22e-4583-826d-c1964771885b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d312821-22fc-4f7a-9a04-88f677a66511", "tag": "f6cc1e71-5824-4e10-98c9-72b30b663270"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:32:55.985376 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-336a02e9-cbd7-4c97-a35f-6d586f531d11 req-1d9d0fa9-f22e-4583-826d-c1964771885b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:55.985834 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-336a02e9-cbd7-4c97-a35f-6d586f531d11 req-1d9d0fa9-f22e-4583-826d-c1964771885b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:56.016667 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-336a02e9-cbd7-4c97-a35f-6d586f531d11 req-1d9d0fa9-f22e-4583-826d-c1964771885b service nova] Creating event network-changed:f6cc1e71-5824-4e10-98c9-72b30b663270 for instance 6d312821-22fc-4f7a-9a04-88f677a66511 on hv-cinder-85031 Jul 21 06:32:56.031898 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-336a02e9-cbd7-4c97-a35f-6d586f531d11 req-1d9d0fa9-f22e-4583-826d-c1964771885b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067244 Jul 21 06:32:56.032815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 194/385] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:32:56.045080 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-10f570d3-532a-4174-8e5e-b784a9a92491 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:56.046099 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-10f570d3-532a-4174-8e5e-b784a9a92491 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:56.056962 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-10f570d3-532a-4174-8e5e-b784a9a92491 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:56.060101 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-10f570d3-532a-4174-8e5e-b784a9a92491 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:56.062782 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-10f570d3-532a-4174-8e5e-b784a9a92491 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:56.070020 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-10f570d3-532a-4174-8e5e-b784a9a92491 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:56.298879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-28eee42c-3eb6-4b86-ab32-d7a4fb690020 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:56.310007 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-28eee42c-3eb6-4b86-ab32-d7a4fb690020 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1371 microversion: 2.1 time: 0.417500 Jul 21 06:32:56.314321 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 192/386] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:55 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:56.438631 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-10f570d3-532a-4174-8e5e-b784a9a92491 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:56.454068 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-10f570d3-532a-4174-8e5e-b784a9a92491 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.415603 Jul 21 06:32:56.454068 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 195/387] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:56 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:56.920406 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1b83de7b-fa5e-4f7b-af45-6cce6e90c761 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:56.921780 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1b83de7b-fa5e-4f7b-af45-6cce6e90c761 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:56.925645 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b45f8c98-840e-4c4a-bba9-3a87f26582b4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:56.927892 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b45f8c98-840e-4c4a-bba9-3a87f26582b4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:56.930111 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1b83de7b-fa5e-4f7b-af45-6cce6e90c761 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:56.930835 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1b83de7b-fa5e-4f7b-af45-6cce6e90c761 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:56.931875 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1b83de7b-fa5e-4f7b-af45-6cce6e90c761 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:56.932634 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1b83de7b-fa5e-4f7b-af45-6cce6e90c761 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:56.942933 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b45f8c98-840e-4c4a-bba9-3a87f26582b4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:56.943416 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b45f8c98-840e-4c4a-bba9-3a87f26582b4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:56.944197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b45f8c98-840e-4c4a-bba9-3a87f26582b4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:56.944640 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b45f8c98-840e-4c4a-bba9-3a87f26582b4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:57.142255 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1b83de7b-fa5e-4f7b-af45-6cce6e90c761 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:57.154307 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1b83de7b-fa5e-4f7b-af45-6cce6e90c761 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:57.157542 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1b83de7b-fa5e-4f7b-af45-6cce6e90c761 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:57.158898 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1b83de7b-fa5e-4f7b-af45-6cce6e90c761 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1741 microversion: 2.20 time: 0.242764 Jul 21 06:32:57.159455 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 193/388] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:56 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:57.205631 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b45f8c98-840e-4c4a-bba9-3a87f26582b4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:57.214551 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b45f8c98-840e-4c4a-bba9-3a87f26582b4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.292553 Jul 21 06:32:57.215485 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 196/389] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:56 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:57.328515 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b3c30367-b0f6-4cd5-b518-44b9523c6ac7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:57.329363 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b3c30367-b0f6-4cd5-b518-44b9523c6ac7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:57.335665 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b3c30367-b0f6-4cd5-b518-44b9523c6ac7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:57.336122 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b3c30367-b0f6-4cd5-b518-44b9523c6ac7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:57.337093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b3c30367-b0f6-4cd5-b518-44b9523c6ac7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:57.337532 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b3c30367-b0f6-4cd5-b518-44b9523c6ac7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:57.491813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-502e508c-4b75-4801-bf84-83ef0a63e6a2 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:57.492435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-502e508c-4b75-4801-bf84-83ef0a63e6a2 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:57.505452 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-502e508c-4b75-4801-bf84-83ef0a63e6a2 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:57.506210 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-502e508c-4b75-4801-bf84-83ef0a63e6a2 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:57.507968 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-502e508c-4b75-4801-bf84-83ef0a63e6a2 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:57.509905 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-502e508c-4b75-4801-bf84-83ef0a63e6a2 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:57.552832 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b3c30367-b0f6-4cd5-b518-44b9523c6ac7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:57.565913 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b3c30367-b0f6-4cd5-b518-44b9523c6ac7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1371 microversion: 2.1 time: 0.239349 Jul 21 06:32:57.572043 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 194/390] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:57 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:57.733428 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-502e508c-4b75-4801-bf84-83ef0a63e6a2 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:57.746730 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-502e508c-4b75-4801-bf84-83ef0a63e6a2 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.259672 Jul 21 06:32:57.748040 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 197/391] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:57 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:58.178931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3d993bf7-b2e5-4397-b2bd-0340617db0bf tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:58.180820 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3d993bf7-b2e5-4397-b2bd-0340617db0bf tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:58.187982 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d993bf7-b2e5-4397-b2bd-0340617db0bf tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:58.188932 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d993bf7-b2e5-4397-b2bd-0340617db0bf tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:58.189981 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d993bf7-b2e5-4397-b2bd-0340617db0bf tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:58.190994 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d993bf7-b2e5-4397-b2bd-0340617db0bf tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:58.238143 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e89f2bc4-ae5b-437b-b303-d14bc183ec84 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:58.239696 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e89f2bc4-ae5b-437b-b303-d14bc183ec84 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:58.257320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e89f2bc4-ae5b-437b-b303-d14bc183ec84 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:58.259498 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e89f2bc4-ae5b-437b-b303-d14bc183ec84 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:58.262300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e89f2bc4-ae5b-437b-b303-d14bc183ec84 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:58.263510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e89f2bc4-ae5b-437b-b303-d14bc183ec84 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:58.704539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3d993bf7-b2e5-4397-b2bd-0340617db0bf tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:58.724396 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3d993bf7-b2e5-4397-b2bd-0340617db0bf tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:58.727070 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3d993bf7-b2e5-4397-b2bd-0340617db0bf tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:58.728268 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3d993bf7-b2e5-4397-b2bd-0340617db0bf tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1741 microversion: 2.20 time: 0.554346 Jul 21 06:32:58.738314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 195/392] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:58 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1741 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:32:58.745172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e89f2bc4-ae5b-437b-b303-d14bc183ec84 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:58.749347 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d669a54d-6b3c-4498-b0c7-d27e2262e92f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:58.749992 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d669a54d-6b3c-4498-b0c7-d27e2262e92f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:58.756233 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e89f2bc4-ae5b-437b-b303-d14bc183ec84 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.525143 Jul 21 06:32:58.757753 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 198/393] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:58 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:32:58.771630 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:58.773467 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d669a54d-6b3c-4498-b0c7-d27e2262e92f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:58.773962 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d669a54d-6b3c-4498-b0c7-d27e2262e92f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:58.774743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d669a54d-6b3c-4498-b0c7-d27e2262e92f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:58.775181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d669a54d-6b3c-4498-b0c7-d27e2262e92f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:58.786000 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8787dc8b-b254-4860-a476-4191052a9450 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:58.786000 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8787dc8b-b254-4860-a476-4191052a9450 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:58.796278 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8787dc8b-b254-4860-a476-4191052a9450 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:58.797173 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8787dc8b-b254-4860-a476-4191052a9450 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:58.798852 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8787dc8b-b254-4860-a476-4191052a9450 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:58.800379 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8787dc8b-b254-4860-a476-4191052a9450 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:58.910533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=14 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:32:59.139594 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d669a54d-6b3c-4498-b0c7-d27e2262e92f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:59.153315 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d669a54d-6b3c-4498-b0c7-d27e2262e92f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1371 microversion: 2.1 time: 0.418456 Jul 21 06:32:59.153911 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 196/394] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:58 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1371 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:59.211995 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8787dc8b-b254-4860-a476-4191052a9450 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:32:59.224434 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8787dc8b-b254-4860-a476-4191052a9450 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.448760 Jul 21 06:32:59.225304 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 199/395] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:58 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:32:59.749043 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-456a22d3-d191-4723-a8a2-59504e9f3028 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:59.749652 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-456a22d3-d191-4723-a8a2-59504e9f3028 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:59.758510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-456a22d3-d191-4723-a8a2-59504e9f3028 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:59.762402 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-456a22d3-d191-4723-a8a2-59504e9f3028 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:59.763226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-456a22d3-d191-4723-a8a2-59504e9f3028 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:59.763679 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-456a22d3-d191-4723-a8a2-59504e9f3028 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:59.779529 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-80b02ac5-feb0-4b67-8b94-17727d81f99d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:32:59.780145 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-80b02ac5-feb0-4b67-8b94-17727d81f99d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:32:59.791192 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-80b02ac5-feb0-4b67-8b94-17727d81f99d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:59.792476 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-80b02ac5-feb0-4b67-8b94-17727d81f99d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:32:59.793699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-80b02ac5-feb0-4b67-8b94-17727d81f99d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:32:59.794332 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-80b02ac5-feb0-4b67-8b94-17727d81f99d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:00.092837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-456a22d3-d191-4723-a8a2-59504e9f3028 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:00.118185 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-456a22d3-d191-4723-a8a2-59504e9f3028 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:00.127938 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-456a22d3-d191-4723-a8a2-59504e9f3028 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:00.132729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-456a22d3-d191-4723-a8a2-59504e9f3028 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1741 microversion: 2.20 time: 0.387637 Jul 21 06:33:00.135223 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 197/396] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:32:59 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1741 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:00.151629 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-80b02ac5-feb0-4b67-8b94-17727d81f99d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:00.163263 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-80b02ac5-feb0-4b67-8b94-17727d81f99d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.389136 Jul 21 06:33:00.164283 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 200/397] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:32:59 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:00.170998 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3b0d8eed-c471-466e-9da6-229453ef48a4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:00.171618 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3b0d8eed-c471-466e-9da6-229453ef48a4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:00.180875 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3b0d8eed-c471-466e-9da6-229453ef48a4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:00.181343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3b0d8eed-c471-466e-9da6-229453ef48a4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:00.182196 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3b0d8eed-c471-466e-9da6-229453ef48a4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:00.182644 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3b0d8eed-c471-466e-9da6-229453ef48a4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:00.243408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fb852d02-24e2-47b3-a5f5-ec70a07e8484 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:00.244031 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fb852d02-24e2-47b3-a5f5-ec70a07e8484 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:00.253093 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb852d02-24e2-47b3-a5f5-ec70a07e8484 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:00.253739 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb852d02-24e2-47b3-a5f5-ec70a07e8484 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:00.255338 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb852d02-24e2-47b3-a5f5-ec70a07e8484 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:00.255944 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb852d02-24e2-47b3-a5f5-ec70a07e8484 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:00.264853 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:00.544567 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fb852d02-24e2-47b3-a5f5-ec70a07e8484 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:00.553964 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fb852d02-24e2-47b3-a5f5-ec70a07e8484 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.316054 Jul 21 06:33:00.555798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 201/398] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:00 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:00.565622 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3b0d8eed-c471-466e-9da6-229453ef48a4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:00.577867 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3b0d8eed-c471-466e-9da6-229453ef48a4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1371 microversion: 2.1 time: 0.410746 Jul 21 06:33:00.578496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 198/399] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:00 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:01.153215 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f544591d-b0e5-4ba1-a65d-09085b63963e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:01.155395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f544591d-b0e5-4ba1-a65d-09085b63963e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:01.166659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f544591d-b0e5-4ba1-a65d-09085b63963e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:01.167859 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f544591d-b0e5-4ba1-a65d-09085b63963e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:01.168906 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f544591d-b0e5-4ba1-a65d-09085b63963e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:01.169439 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f544591d-b0e5-4ba1-a65d-09085b63963e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:01.183123 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-73fcc33d-4c2f-4db4-8917-f28de791ee4c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:01.184805 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-73fcc33d-4c2f-4db4-8917-f28de791ee4c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:01.200813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73fcc33d-4c2f-4db4-8917-f28de791ee4c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:01.201917 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73fcc33d-4c2f-4db4-8917-f28de791ee4c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:01.202977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73fcc33d-4c2f-4db4-8917-f28de791ee4c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:01.204275 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73fcc33d-4c2f-4db4-8917-f28de791ee4c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:01.407778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f544591d-b0e5-4ba1-a65d-09085b63963e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:01.418075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f544591d-b0e5-4ba1-a65d-09085b63963e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:01.431101 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f544591d-b0e5-4ba1-a65d-09085b63963e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:01.433810 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f544591d-b0e5-4ba1-a65d-09085b63963e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1741 microversion: 2.20 time: 0.285602 Jul 21 06:33:01.439930 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 202/400] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:01 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1741 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:01.486572 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-73fcc33d-4c2f-4db4-8917-f28de791ee4c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:01.496413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-73fcc33d-4c2f-4db4-8917-f28de791ee4c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.318960 Jul 21 06:33:01.499843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 199/401] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:01 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:01.581422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5540b700-0d36-447a-8a49-f54efc030159 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:01.582884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5540b700-0d36-447a-8a49-f54efc030159 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:01.595045 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5540b700-0d36-447a-8a49-f54efc030159 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:01.595533 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5540b700-0d36-447a-8a49-f54efc030159 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:01.596331 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5540b700-0d36-447a-8a49-f54efc030159 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:01.596798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5540b700-0d36-447a-8a49-f54efc030159 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:01.600348 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-51706119-ccaa-4dc9-b36e-bd4629005239 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:01.601552 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-51706119-ccaa-4dc9-b36e-bd4629005239 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:01.610090 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-51706119-ccaa-4dc9-b36e-bd4629005239 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:01.611393 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-51706119-ccaa-4dc9-b36e-bd4629005239 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:01.612524 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-51706119-ccaa-4dc9-b36e-bd4629005239 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:01.613251 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-51706119-ccaa-4dc9-b36e-bd4629005239 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:01.858816 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5540b700-0d36-447a-8a49-f54efc030159 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:01.875625 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5540b700-0d36-447a-8a49-f54efc030159 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.303680 Jul 21 06:33:01.887375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 203/402] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:01 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:01.923600 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-51706119-ccaa-4dc9-b36e-bd4629005239 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:01.934267 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-51706119-ccaa-4dc9-b36e-bd4629005239 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1371 microversion: 2.1 time: 0.342087 Jul 21 06:33:01.944139 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 200/403] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:01 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:02.141534 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0afaeb55-546b-4fd6-867d-882ff4a159a4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: .version_select at 0x7f9327c0fdc0>, body: {"keypair": {"name": "tempest-keypair-895641349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4vE9UVflZ5ozGeIc4QYbCut9IUw2H3wYCF6BcOfajZeoW9xC5sCAOJkBHnBUC42RBfwZFV6GOkG0JjkslLaG9bXFWHjCW5aaUys4p1Rb1wPT8+5OhoFooX0YbFpu8vfw=="}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:02.161224 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-0afaeb55-546b-4fd6-867d-882ff4a159a4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:33:02.169181 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-0afaeb55-546b-4fd6-867d-882ff4a159a4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for user 5c54ac39faa84c7db5b9b63360216d7b and project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:33:02.206503 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0afaeb55-546b-4fd6-867d-882ff4a159a4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069223 Jul 21 06:33:02.207166 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 204/404] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 06:33:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:02.273472 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-ba97367f-e181-4d43-a101-f361f5b2ed32 req-b9c819a2-b7b5-464e-80f5-86cf7a8c4f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d312821-22fc-4f7a-9a04-88f677a66511", "name": "network-vif-plugged", "status": "completed", "tag": "f6cc1e71-5824-4e10-98c9-72b30b663270"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:02.282221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:02.299350 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-ba97367f-e181-4d43-a101-f361f5b2ed32 req-b9c819a2-b7b5-464e-80f5-86cf7a8c4f32 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:02.303699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-ba97367f-e181-4d43-a101-f361f5b2ed32 req-b9c819a2-b7b5-464e-80f5-86cf7a8c4f32 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:02.323791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-ba97367f-e181-4d43-a101-f361f5b2ed32 req-b9c819a2-b7b5-464e-80f5-86cf7a8c4f32 service nova] Creating event network-vif-plugged:f6cc1e71-5824-4e10-98c9-72b30b663270 for instance 6d312821-22fc-4f7a-9a04-88f677a66511 on hv-cinder-85031 Jul 21 06:33:02.331707 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-ba97367f-e181-4d43-a101-f361f5b2ed32 req-b9c819a2-b7b5-464e-80f5-86cf7a8c4f32 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063513 Jul 21 06:33:02.333396 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 201/405] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:02.458430 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0f22777f-46ee-4c17-9b6f-80bb75b3091c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:02.458971 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0f22777f-46ee-4c17-9b6f-80bb75b3091c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:02.475053 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0f22777f-46ee-4c17-9b6f-80bb75b3091c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:02.475802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0f22777f-46ee-4c17-9b6f-80bb75b3091c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:02.476971 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0f22777f-46ee-4c17-9b6f-80bb75b3091c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:02.477623 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0f22777f-46ee-4c17-9b6f-80bb75b3091c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:02.516263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-17305264-6d46-4e37-98f2-3cb7326409f1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:02.517234 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-17305264-6d46-4e37-98f2-3cb7326409f1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:02.539513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-17305264-6d46-4e37-98f2-3cb7326409f1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:02.547081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-17305264-6d46-4e37-98f2-3cb7326409f1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:02.547081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-17305264-6d46-4e37-98f2-3cb7326409f1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:02.547081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-17305264-6d46-4e37-98f2-3cb7326409f1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:02.718099 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0f22777f-46ee-4c17-9b6f-80bb75b3091c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:02.739190 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0f22777f-46ee-4c17-9b6f-80bb75b3091c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:02.741322 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0f22777f-46ee-4c17-9b6f-80bb75b3091c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:02.742756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0f22777f-46ee-4c17-9b6f-80bb75b3091c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1741 microversion: 2.20 time: 0.288647 Jul 21 06:33:02.753997 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 205/406] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:02 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1741 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:02.843162 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-17305264-6d46-4e37-98f2-3cb7326409f1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:02.858097 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-17305264-6d46-4e37-98f2-3cb7326409f1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.346008 Jul 21 06:33:02.858890 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 202/407] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:02 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:02.895988 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ed852a1a-a3e9-42f4-8fc5-e095d4b304e7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:02.897009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ed852a1a-a3e9-42f4-8fc5-e095d4b304e7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:02.904055 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed852a1a-a3e9-42f4-8fc5-e095d4b304e7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:02.904504 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed852a1a-a3e9-42f4-8fc5-e095d4b304e7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:02.905957 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed852a1a-a3e9-42f4-8fc5-e095d4b304e7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:02.906406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed852a1a-a3e9-42f4-8fc5-e095d4b304e7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:02.951420 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c5e57421-c76a-4a98-b13f-086070ce3809 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:02.952043 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c5e57421-c76a-4a98-b13f-086070ce3809 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:02.960388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5e57421-c76a-4a98-b13f-086070ce3809 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:02.960851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5e57421-c76a-4a98-b13f-086070ce3809 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:02.961672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5e57421-c76a-4a98-b13f-086070ce3809 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:02.962116 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5e57421-c76a-4a98-b13f-086070ce3809 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:02.990710 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:03.239879 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ed852a1a-a3e9-42f4-8fc5-e095d4b304e7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:03.252862 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ed852a1a-a3e9-42f4-8fc5-e095d4b304e7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1278 microversion: 2.1 time: 0.361951 Jul 21 06:33:03.254061 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 206/408] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:02 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1278 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:03.272766 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1213420459", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452"}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:03.331451 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c5e57421-c76a-4a98-b13f-086070ce3809 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:03.342489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c5e57421-c76a-4a98-b13f-086070ce3809 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1371 microversion: 2.1 time: 0.394957 Jul 21 06:33:03.352996 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 203/409] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:02 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:03.761699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f7c73d4e-7877-4d2e-97c5-530936ee394a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:03.762843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f7c73d4e-7877-4d2e-97c5-530936ee394a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:03.773336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7c73d4e-7877-4d2e-97c5-530936ee394a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:03.774154 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7c73d4e-7877-4d2e-97c5-530936ee394a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:03.775298 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7c73d4e-7877-4d2e-97c5-530936ee394a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:03.775919 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7c73d4e-7877-4d2e-97c5-530936ee394a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:04.030966 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f7c73d4e-7877-4d2e-97c5-530936ee394a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:04.039441 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f7c73d4e-7877-4d2e-97c5-530936ee394a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:04.046039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f7c73d4e-7877-4d2e-97c5-530936ee394a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:04.046039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f7c73d4e-7877-4d2e-97c5-530936ee394a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1741 microversion: 2.20 time: 0.287146 Jul 21 06:33:04.046039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 204/410] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:03 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1741 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:04.063371 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-92293b39-0cb1-4fc8-8160-ddd5eee20c02 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:04.063604 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-92293b39-0cb1-4fc8-8160-ddd5eee20c02 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:04.069931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-92293b39-0cb1-4fc8-8160-ddd5eee20c02 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:04.070446 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-92293b39-0cb1-4fc8-8160-ddd5eee20c02 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:04.071237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-92293b39-0cb1-4fc8-8160-ddd5eee20c02 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:04.071686 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-92293b39-0cb1-4fc8-8160-ddd5eee20c02 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:04.250287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-92293b39-0cb1-4fc8-8160-ddd5eee20c02 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:04.263098 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-92293b39-0cb1-4fc8-8160-ddd5eee20c02 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.213545 Jul 21 06:33:04.264287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 205/411] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:04 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:04.270592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a030ef36-c138-4d06-a596-31d0c13c9955 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:04.271311 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a030ef36-c138-4d06-a596-31d0c13c9955 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:04.278649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a030ef36-c138-4d06-a596-31d0c13c9955 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:04.279182 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a030ef36-c138-4d06-a596-31d0c13c9955 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:04.280203 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a030ef36-c138-4d06-a596-31d0c13c9955 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:04.280837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a030ef36-c138-4d06-a596-31d0c13c9955 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:04.493672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a030ef36-c138-4d06-a596-31d0c13c9955 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:04.503743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a030ef36-c138-4d06-a596-31d0c13c9955 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.237584 Jul 21 06:33:04.515137 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 206/412] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:04 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:04.521181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-642fdfc5-bdc1-42e2-af57-7be81a7db2e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:04.522130 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-642fdfc5-bdc1-42e2-af57-7be81a7db2e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:04.530137 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-642fdfc5-bdc1-42e2-af57-7be81a7db2e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:04.531113 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-642fdfc5-bdc1-42e2-af57-7be81a7db2e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:04.532314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-642fdfc5-bdc1-42e2-af57-7be81a7db2e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:04.533098 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-642fdfc5-bdc1-42e2-af57-7be81a7db2e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:04.720812 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-642fdfc5-bdc1-42e2-af57-7be81a7db2e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:04.731375 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-642fdfc5-bdc1-42e2-af57-7be81a7db2e5 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1371 microversion: 2.1 time: 0.214722 Jul 21 06:33:04.732567 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 207/413] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:04 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:04.737900 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1518814129", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fac3a692-b3e2-4555-a0ad-f0227031fd7d"}], "security_groups": [{"name": "tempest-securitygroup--1844331636"}], "key_name": "tempest-keypair-895641349", "user_data": "}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:06.623044 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.network.neutron [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] validate_networks() for None {{(pid=117905) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:33:06.765361 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] validate_networks() for [('fac3a692-b3e2-4555-a0ad-f0227031fd7d', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:33:07.028752 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Flavor limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:33:07.029184 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Image limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:33:07.029664 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Flavor pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:33:07.030130 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Image pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:33:07.030793 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:33:07.041150 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.041598 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.042442 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.042881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.067348 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Getting quotas for project eb38392ff9294ce08fb43f32f6176c4c. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:33:07.071833 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Getting quotas for user 7425f2b3ad664922961e848dfdd010d3 and project eb38392ff9294ce08fb43f32f6176c4c. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:33:07.085653 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Going to run 1 instances... {{(pid=117905) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:33:07.088289 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:33:07.134898 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-62db1fbc-be3d-4703-85b5-1497393dc274 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.879193 Jul 21 06:33:07.135719 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 207/414] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:33:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:33:07.144226 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d7a3a45f-ea11-4f4f-b56b-766b7a8b47d2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:07.145786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d7a3a45f-ea11-4f4f-b56b-766b7a8b47d2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:07.153226 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d7a3a45f-ea11-4f4f-b56b-766b7a8b47d2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.153681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d7a3a45f-ea11-4f4f-b56b-766b7a8b47d2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.154501 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d7a3a45f-ea11-4f4f-b56b-766b7a8b47d2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.154944 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d7a3a45f-ea11-4f4f-b56b-766b7a8b47d2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.403506 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d7a3a45f-ea11-4f4f-b56b-766b7a8b47d2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:07.413441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d7a3a45f-ea11-4f4f-b56b-766b7a8b47d2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:07.415382 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d7a3a45f-ea11-4f4f-b56b-766b7a8b47d2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:07.416567 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d7a3a45f-ea11-4f4f-b56b-766b7a8b47d2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1723 microversion: 2.20 time: 0.280016 Jul 21 06:33:07.417138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 208/415] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:07 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:07.421749 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c935ab08-15d6-4ae0-8457-12044b83f87c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:07.422555 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c935ab08-15d6-4ae0-8457-12044b83f87c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:07.429513 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c935ab08-15d6-4ae0-8457-12044b83f87c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.430253 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c935ab08-15d6-4ae0-8457-12044b83f87c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.431281 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c935ab08-15d6-4ae0-8457-12044b83f87c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.431895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c935ab08-15d6-4ae0-8457-12044b83f87c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.493849 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:33:07.493849 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:33:07.494237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:33:07.494684 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:33:07.495282 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:33:07.505282 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.505824 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.507039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.507551 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.529699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:33:07.547421 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for user 5c54ac39faa84c7db5b9b63360216d7b and project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:33:07.563054 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:33:07.566749 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:33:07.624411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-15544923-184f-488a-abe7-1b2aa9d14cd9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.890653 Jul 21 06:33:07.625403 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 208/416] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:33:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:33:07.630398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-591f53cf-c10e-4202-89e1-9684df89836b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:07.631339 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-591f53cf-c10e-4202-89e1-9684df89836b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:07.639304 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-591f53cf-c10e-4202-89e1-9684df89836b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.639768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-591f53cf-c10e-4202-89e1-9684df89836b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.640550 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-591f53cf-c10e-4202-89e1-9684df89836b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.641081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-591f53cf-c10e-4202-89e1-9684df89836b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.677665 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c935ab08-15d6-4ae0-8457-12044b83f87c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:07.688453 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c935ab08-15d6-4ae0-8457-12044b83f87c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.270112 Jul 21 06:33:07.689688 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 209/417] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:07 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:07.694626 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9b493543-ca60-4fbe-b4fa-93d58377aed8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:07.695667 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9b493543-ca60-4fbe-b4fa-93d58377aed8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:07.702392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9b493543-ca60-4fbe-b4fa-93d58377aed8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.703198 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9b493543-ca60-4fbe-b4fa-93d58377aed8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:07.704265 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9b493543-ca60-4fbe-b4fa-93d58377aed8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:07.704921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9b493543-ca60-4fbe-b4fa-93d58377aed8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:08.053193 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-591f53cf-c10e-4202-89e1-9684df89836b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:08.060995 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-591f53cf-c10e-4202-89e1-9684df89836b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.434227 Jul 21 06:33:08.061929 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 209/418] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:07 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:08.066943 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5fed1bd7-53df-4a0d-b403-7a606ac24422 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:08.067886 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5fed1bd7-53df-4a0d-b403-7a606ac24422 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:08.073589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9b493543-ca60-4fbe-b4fa-93d58377aed8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:08.074143 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5fed1bd7-53df-4a0d-b403-7a606ac24422 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:08.074692 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5fed1bd7-53df-4a0d-b403-7a606ac24422 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:08.075384 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5fed1bd7-53df-4a0d-b403-7a606ac24422 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:08.075863 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5fed1bd7-53df-4a0d-b403-7a606ac24422 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:08.082792 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9b493543-ca60-4fbe-b4fa-93d58377aed8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1565 microversion: 2.1 time: 0.391242 Jul 21 06:33:08.083515 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 210/419] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:07 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1565 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:08.088765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c220cf2c-a687-475c-aa62-eeb112506ad9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:08.089442 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c220cf2c-a687-475c-aa62-eeb112506ad9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:08.102432 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c220cf2c-a687-475c-aa62-eeb112506ad9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:08.103277 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c220cf2c-a687-475c-aa62-eeb112506ad9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:08.104763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c220cf2c-a687-475c-aa62-eeb112506ad9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:08.105625 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c220cf2c-a687-475c-aa62-eeb112506ad9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:08.147070 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5fed1bd7-53df-4a0d-b403-7a606ac24422 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:08.155153 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5fed1bd7-53df-4a0d-b403-7a606ac24422 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1267 microversion: 2.1 time: 0.092490 Jul 21 06:33:08.155747 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 210/420] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:08 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:08.160564 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c98d8466-bc1e-4623-957d-7b7b24a19f15 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:08.161052 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c98d8466-bc1e-4623-957d-7b7b24a19f15 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:08.167445 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c98d8466-bc1e-4623-957d-7b7b24a19f15 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:08.167931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c98d8466-bc1e-4623-957d-7b7b24a19f15 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:08.168701 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c98d8466-bc1e-4623-957d-7b7b24a19f15 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:08.169147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c98d8466-bc1e-4623-957d-7b7b24a19f15 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:08.173866 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c220cf2c-a687-475c-aa62-eeb112506ad9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:08.182043 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c220cf2c-a687-475c-aa62-eeb112506ad9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1245 microversion: 2.1 time: 0.097255 Jul 21 06:33:08.183332 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 211/421] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:08 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:08.249170 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c98d8466-bc1e-4623-957d-7b7b24a19f15 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092333 Jul 21 06:33:08.249767 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 211/422] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 06:33:08 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:08.438174 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-581cebc2-5567-4af3-8d31-b306bc6911b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:08.439260 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-581cebc2-5567-4af3-8d31-b306bc6911b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:08.446297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-581cebc2-5567-4af3-8d31-b306bc6911b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:08.447042 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-581cebc2-5567-4af3-8d31-b306bc6911b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:08.447989 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-581cebc2-5567-4af3-8d31-b306bc6911b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:08.448585 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-581cebc2-5567-4af3-8d31-b306bc6911b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:08.718021 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e4c79c6e-d794-4e6c-9c33-e2ca7b18f4cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:08.719581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e4c79c6e-d794-4e6c-9c33-e2ca7b18f4cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:08.730456 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e4c79c6e-d794-4e6c-9c33-e2ca7b18f4cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:08.731760 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e4c79c6e-d794-4e6c-9c33-e2ca7b18f4cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:08.732627 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e4c79c6e-d794-4e6c-9c33-e2ca7b18f4cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:08.733142 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e4c79c6e-d794-4e6c-9c33-e2ca7b18f4cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:09.031261 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-581cebc2-5567-4af3-8d31-b306bc6911b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:09.040563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-581cebc2-5567-4af3-8d31-b306bc6911b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:09.042122 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-581cebc2-5567-4af3-8d31-b306bc6911b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:09.043481 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-581cebc2-5567-4af3-8d31-b306bc6911b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1723 microversion: 2.20 time: 0.609406 Jul 21 06:33:09.044049 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 212/423] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:08 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1723 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:09.078070 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b1ad526c-e2ae-40a4-b7da-086b3212b760 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:09.078614 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b1ad526c-e2ae-40a4-b7da-086b3212b760 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:09.087440 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e4c79c6e-d794-4e6c-9c33-e2ca7b18f4cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:09.087936 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1ad526c-e2ae-40a4-b7da-086b3212b760 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:09.088053 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1ad526c-e2ae-40a4-b7da-086b3212b760 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:09.088740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1ad526c-e2ae-40a4-b7da-086b3212b760 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:09.089235 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1ad526c-e2ae-40a4-b7da-086b3212b760 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:09.096990 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e4c79c6e-d794-4e6c-9c33-e2ca7b18f4cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.388075 Jul 21 06:33:09.098193 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 212/424] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:08 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:09.172701 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d5925031-f348-4384-96b6-6113ec1df96c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:09.173317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d5925031-f348-4384-96b6-6113ec1df96c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:09.180880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d5925031-f348-4384-96b6-6113ec1df96c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:09.181420 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d5925031-f348-4384-96b6-6113ec1df96c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:09.182869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d5925031-f348-4384-96b6-6113ec1df96c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:09.182869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d5925031-f348-4384-96b6-6113ec1df96c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:09.276780 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d5925031-f348-4384-96b6-6113ec1df96c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:09.284140 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d5925031-f348-4384-96b6-6113ec1df96c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1273 microversion: 2.1 time: 0.115416 Jul 21 06:33:09.284703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 213/425] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:09 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:09.289671 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e1590127-8b34-4ffd-8032-9b7161111069 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:09.290479 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e1590127-8b34-4ffd-8032-9b7161111069 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:09.300259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e1590127-8b34-4ffd-8032-9b7161111069 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:09.300768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e1590127-8b34-4ffd-8032-9b7161111069 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:09.301698 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e1590127-8b34-4ffd-8032-9b7161111069 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:09.302168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e1590127-8b34-4ffd-8032-9b7161111069 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:09.358027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b1ad526c-e2ae-40a4-b7da-086b3212b760 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:09.366772 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b1ad526c-e2ae-40a4-b7da-086b3212b760 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.292465 Jul 21 06:33:09.375185 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 213/426] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:09 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:09.381060 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e1590127-8b34-4ffd-8032-9b7161111069 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:09.389794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e1590127-8b34-4ffd-8032-9b7161111069 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1293 microversion: 2.1 time: 0.103518 Jul 21 06:33:09.390392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 214/427] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:09 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:09.835809 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-cf34c4a7-daab-4d4a-bbfc-599e31823a26 req-e1f49eb7-c176-497b-9e37-88624f6c134e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d312821-22fc-4f7a-9a04-88f677a66511", "tag": "f6cc1e71-5824-4e10-98c9-72b30b663270"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:09.844156 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-cf34c4a7-daab-4d4a-bbfc-599e31823a26 req-e1f49eb7-c176-497b-9e37-88624f6c134e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:09.844616 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-cf34c4a7-daab-4d4a-bbfc-599e31823a26 req-e1f49eb7-c176-497b-9e37-88624f6c134e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:09.857379 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-cf34c4a7-daab-4d4a-bbfc-599e31823a26 req-e1f49eb7-c176-497b-9e37-88624f6c134e service nova] Creating event network-changed:f6cc1e71-5824-4e10-98c9-72b30b663270 for instance 6d312821-22fc-4f7a-9a04-88f677a66511 on hv-cinder-85031 Jul 21 06:33:09.862613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-cf34c4a7-daab-4d4a-bbfc-599e31823a26 req-e1f49eb7-c176-497b-9e37-88624f6c134e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030491 Jul 21 06:33:09.863891 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 214/428] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:10.063177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0825f158-6009-46a3-a03e-f464d77d35bd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:10.063795 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0825f158-6009-46a3-a03e-f464d77d35bd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:10.070587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0825f158-6009-46a3-a03e-f464d77d35bd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:10.071184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0825f158-6009-46a3-a03e-f464d77d35bd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:10.071807 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0825f158-6009-46a3-a03e-f464d77d35bd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:10.072243 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0825f158-6009-46a3-a03e-f464d77d35bd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:10.116796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-04c10da3-08fa-46b6-8fe9-7bf2799958aa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:10.117617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-04c10da3-08fa-46b6-8fe9-7bf2799958aa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:10.124049 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-04c10da3-08fa-46b6-8fe9-7bf2799958aa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:10.124586 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-04c10da3-08fa-46b6-8fe9-7bf2799958aa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:10.125427 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-04c10da3-08fa-46b6-8fe9-7bf2799958aa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:10.125934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-04c10da3-08fa-46b6-8fe9-7bf2799958aa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:10.270967 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0825f158-6009-46a3-a03e-f464d77d35bd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:10.283963 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0825f158-6009-46a3-a03e-f464d77d35bd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:10.286709 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0825f158-6009-46a3-a03e-f464d77d35bd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:10.288247 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0825f158-6009-46a3-a03e-f464d77d35bd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1723 microversion: 2.20 time: 0.229075 Jul 21 06:33:10.289029 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 215/429] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:10 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:10.301432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-79f06a33-49d6-408b-8015-d0a431503b28 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:10.302084 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-79f06a33-49d6-408b-8015-d0a431503b28 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:10.307988 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-04c10da3-08fa-46b6-8fe9-7bf2799958aa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:10.316367 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-04c10da3-08fa-46b6-8fe9-7bf2799958aa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.203925 Jul 21 06:33:10.316964 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 215/430] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:10 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:10.320518 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-79f06a33-49d6-408b-8015-d0a431503b28 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:10.320971 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-79f06a33-49d6-408b-8015-d0a431503b28 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:10.321754 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-79f06a33-49d6-408b-8015-d0a431503b28 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:10.322224 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-79f06a33-49d6-408b-8015-d0a431503b28 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:10.383901 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5e9dc313-a500-484f-a4f1-8fa0d95d9958 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:10.384526 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5e9dc313-a500-484f-a4f1-8fa0d95d9958 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:10.390704 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5e9dc313-a500-484f-a4f1-8fa0d95d9958 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:10.391371 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5e9dc313-a500-484f-a4f1-8fa0d95d9958 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:10.391500 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-79f06a33-49d6-408b-8015-d0a431503b28 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:10.392161 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5e9dc313-a500-484f-a4f1-8fa0d95d9958 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:10.392602 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5e9dc313-a500-484f-a4f1-8fa0d95d9958 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:10.400058 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-79f06a33-49d6-408b-8015-d0a431503b28 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1273 microversion: 2.1 time: 0.102285 Jul 21 06:33:10.401403 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 216/431] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:10 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:10.406954 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b93395ed-7091-468d-8c75-f556de44404b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:10.407818 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b93395ed-7091-468d-8c75-f556de44404b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:10.414874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b93395ed-7091-468d-8c75-f556de44404b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:10.415621 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b93395ed-7091-468d-8c75-f556de44404b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:10.416446 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b93395ed-7091-468d-8c75-f556de44404b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:10.417041 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b93395ed-7091-468d-8c75-f556de44404b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:10.494947 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b93395ed-7091-468d-8c75-f556de44404b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:10.502614 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b93395ed-7091-468d-8c75-f556de44404b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1293 microversion: 2.1 time: 0.099181 Jul 21 06:33:10.503188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 217/432] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:10 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:10.556684 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5e9dc313-a500-484f-a4f1-8fa0d95d9958 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:10.564368 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5e9dc313-a500-484f-a4f1-8fa0d95d9958 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.184180 Jul 21 06:33:10.564961 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 216/433] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:10 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:11.306982 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-db25a3e6-3a4f-4dc6-b013-ebae549e19ec tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:11.307666 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-db25a3e6-3a4f-4dc6-b013-ebae549e19ec tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:11.315693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-db25a3e6-3a4f-4dc6-b013-ebae549e19ec tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:11.316144 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-db25a3e6-3a4f-4dc6-b013-ebae549e19ec tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:11.317513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-db25a3e6-3a4f-4dc6-b013-ebae549e19ec tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:11.318179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-db25a3e6-3a4f-4dc6-b013-ebae549e19ec tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:11.334451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7124f0b4-6356-44dc-9ad0-d89258f109ba tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:11.335648 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7124f0b4-6356-44dc-9ad0-d89258f109ba tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:11.342115 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7124f0b4-6356-44dc-9ad0-d89258f109ba tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:11.342562 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7124f0b4-6356-44dc-9ad0-d89258f109ba tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:11.343370 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7124f0b4-6356-44dc-9ad0-d89258f109ba tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:11.343794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7124f0b4-6356-44dc-9ad0-d89258f109ba tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:11.552999 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-db25a3e6-3a4f-4dc6-b013-ebae549e19ec tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:11.558360 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7124f0b4-6356-44dc-9ad0-d89258f109ba tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:11.561430 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-db25a3e6-3a4f-4dc6-b013-ebae549e19ec tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:11.562995 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-db25a3e6-3a4f-4dc6-b013-ebae549e19ec tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:11.564577 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-db25a3e6-3a4f-4dc6-b013-ebae549e19ec tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1723 microversion: 2.20 time: 0.261532 Jul 21 06:33:11.565147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 218/434] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:11 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:11.576274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7124f0b4-6356-44dc-9ad0-d89258f109ba tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.237830 Jul 21 06:33:11.576274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 217/435] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:11 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:11.576274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3756cb11-1338-4990-94ce-bf21ca89a19c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:11.576274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3756cb11-1338-4990-94ce-bf21ca89a19c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:11.580324 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3756cb11-1338-4990-94ce-bf21ca89a19c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:11.580778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3756cb11-1338-4990-94ce-bf21ca89a19c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:11.581556 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3756cb11-1338-4990-94ce-bf21ca89a19c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:11.581676 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-accc6abd-b71c-4956-a374-c6839be28b6c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:11.582324 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-accc6abd-b71c-4956-a374-c6839be28b6c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:11.582496 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3756cb11-1338-4990-94ce-bf21ca89a19c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:11.588531 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-accc6abd-b71c-4956-a374-c6839be28b6c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:11.590508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-accc6abd-b71c-4956-a374-c6839be28b6c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:11.591431 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-accc6abd-b71c-4956-a374-c6839be28b6c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:11.591879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-accc6abd-b71c-4956-a374-c6839be28b6c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:11.685929 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-accc6abd-b71c-4956-a374-c6839be28b6c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:11.701123 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-accc6abd-b71c-4956-a374-c6839be28b6c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1293 microversion: 2.1 time: 0.123271 Jul 21 06:33:11.701996 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 219/436] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:11 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1293 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:11.719969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1fc054c8-9f9f-4e68-9a4d-1643907e6f9f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:11.722339 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1fc054c8-9f9f-4e68-9a4d-1643907e6f9f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:11.739138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1fc054c8-9f9f-4e68-9a4d-1643907e6f9f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:11.739728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1fc054c8-9f9f-4e68-9a4d-1643907e6f9f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:11.742020 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1fc054c8-9f9f-4e68-9a4d-1643907e6f9f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:11.743096 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1fc054c8-9f9f-4e68-9a4d-1643907e6f9f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:11.852311 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3756cb11-1338-4990-94ce-bf21ca89a19c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:11.860000 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3756cb11-1338-4990-94ce-bf21ca89a19c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.290557 Jul 21 06:33:11.861017 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 218/437] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:11 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:11.928029 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1fc054c8-9f9f-4e68-9a4d-1643907e6f9f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:11.935918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1fc054c8-9f9f-4e68-9a4d-1643907e6f9f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.229582 Jul 21 06:33:11.936507 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 220/438] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:11 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:12.221449 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-302c4560-dc45-4342-8f0c-acab7937ac1b req-53fc903c-1b69-4b72-a64e-1c0e18d1ae67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40d32b1-a161-49f9-a2ae-fe794e9a66cd", "name": "network-vif-unplugged", "status": "completed", "tag": "345fc32c-f55c-4636-be16-4b276cd0c105"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:12.225264 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:12.232738 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-302c4560-dc45-4342-8f0c-acab7937ac1b req-53fc903c-1b69-4b72-a64e-1c0e18d1ae67 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.233320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-302c4560-dc45-4342-8f0c-acab7937ac1b req-53fc903c-1b69-4b72-a64e-1c0e18d1ae67 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:12.246862 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-302c4560-dc45-4342-8f0c-acab7937ac1b req-53fc903c-1b69-4b72-a64e-1c0e18d1ae67 service nova] Creating event network-vif-unplugged:345fc32c-f55c-4636-be16-4b276cd0c105 for instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd on hv-cinder-85031 Jul 21 06:33:12.252064 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-302c4560-dc45-4342-8f0c-acab7937ac1b req-53fc903c-1b69-4b72-a64e-1c0e18d1ae67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034345 Jul 21 06:33:12.252641 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 219/439] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:12.584614 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7d790cc6-2923-495f-89dd-b821216aedeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:12.585223 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7d790cc6-2923-495f-89dd-b821216aedeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:12.586378 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c65f713c-02e7-4a97-9bc1-979afca47d75 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:12.587077 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c65f713c-02e7-4a97-9bc1-979afca47d75 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:12.591826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7d790cc6-2923-495f-89dd-b821216aedeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.592275 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7d790cc6-2923-495f-89dd-b821216aedeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:12.593047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7d790cc6-2923-495f-89dd-b821216aedeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.593462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7d790cc6-2923-495f-89dd-b821216aedeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:12.593573 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c65f713c-02e7-4a97-9bc1-979afca47d75 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.593984 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c65f713c-02e7-4a97-9bc1-979afca47d75 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:12.594746 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c65f713c-02e7-4a97-9bc1-979afca47d75 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.595177 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c65f713c-02e7-4a97-9bc1-979afca47d75 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:12.598093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:12.791794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7d790cc6-2923-495f-89dd-b821216aedeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:12.795100 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c65f713c-02e7-4a97-9bc1-979afca47d75 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:12.798860 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:12.805380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c65f713c-02e7-4a97-9bc1-979afca47d75 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.224316 Jul 21 06:33:12.805975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 220/440] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:12 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:12.810349 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2b21d4e5-9c6c-4fce-98d6-02be1d02d366 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:12.811135 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2b21d4e5-9c6c-4fce-98d6-02be1d02d366 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:12.813125 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7d790cc6-2923-495f-89dd-b821216aedeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:12.814661 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7d790cc6-2923-495f-89dd-b821216aedeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:12.815888 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7d790cc6-2923-495f-89dd-b821216aedeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1723 microversion: 2.20 time: 0.235874 Jul 21 06:33:12.816513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 221/441] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:12 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:12.817824 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b21d4e5-9c6c-4fce-98d6-02be1d02d366 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.818310 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b21d4e5-9c6c-4fce-98d6-02be1d02d366 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:12.819077 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b21d4e5-9c6c-4fce-98d6-02be1d02d366 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.819508 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b21d4e5-9c6c-4fce-98d6-02be1d02d366 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:12.878081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b752f9e7-d6de-4d34-af7e-3aaf338e5cbc tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:12.879718 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b752f9e7-d6de-4d34-af7e-3aaf338e5cbc tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:12.887573 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b752f9e7-d6de-4d34-af7e-3aaf338e5cbc tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.888250 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b752f9e7-d6de-4d34-af7e-3aaf338e5cbc tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:12.889304 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b752f9e7-d6de-4d34-af7e-3aaf338e5cbc tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.889888 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b752f9e7-d6de-4d34-af7e-3aaf338e5cbc tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:12.906295 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2b21d4e5-9c6c-4fce-98d6-02be1d02d366 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:12.922522 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2b21d4e5-9c6c-4fce-98d6-02be1d02d366 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1301 microversion: 2.1 time: 0.115207 Jul 21 06:33:12.924575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 221/442] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:12 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1301 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:12.953856 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fc515c9c-c2c2-49c5-b4cd-8cb8b79b90d0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:12.954820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fc515c9c-c2c2-49c5-b4cd-8cb8b79b90d0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:12.962549 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc515c9c-c2c2-49c5-b4cd-8cb8b79b90d0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.962998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc515c9c-c2c2-49c5-b4cd-8cb8b79b90d0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:12.963821 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc515c9c-c2c2-49c5-b4cd-8cb8b79b90d0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:12.964259 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc515c9c-c2c2-49c5-b4cd-8cb8b79b90d0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:13.136279 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b752f9e7-d6de-4d34-af7e-3aaf338e5cbc tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:13.144070 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b752f9e7-d6de-4d34-af7e-3aaf338e5cbc tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.269971 Jul 21 06:33:13.145360 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 222/443] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:12 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:13.167587 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fc515c9c-c2c2-49c5-b4cd-8cb8b79b90d0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:13.175020 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fc515c9c-c2c2-49c5-b4cd-8cb8b79b90d0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.226014 Jul 21 06:33:13.176211 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 222/444] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:12 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:13.804246 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-5645d384-f1b4-4f2e-ab60-ab4a725ed2d6 req-f7fbc608-8349-4e85-9b3a-3fcba4eb58cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24361d41-5ef8-4321-83a7-78a2343df7cf", "tag": "f8ba934b-7de0-4f79-8aab-dce56ba52871"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:13.815266 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-5645d384-f1b4-4f2e-ab60-ab4a725ed2d6 req-f7fbc608-8349-4e85-9b3a-3fcba4eb58cf service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:13.815733 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-5645d384-f1b4-4f2e-ab60-ab4a725ed2d6 req-f7fbc608-8349-4e85-9b3a-3fcba4eb58cf service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:13.824412 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-63d1bf0a-1481-48ae-928c-010b65c8775f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:13.826091 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-63d1bf0a-1481-48ae-928c-010b65c8775f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:13.840081 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-63d1bf0a-1481-48ae-928c-010b65c8775f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:13.843323 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-63d1bf0a-1481-48ae-928c-010b65c8775f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:13.857175 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-5645d384-f1b4-4f2e-ab60-ab4a725ed2d6 req-f7fbc608-8349-4e85-9b3a-3fcba4eb58cf service nova] Creating event network-changed:f8ba934b-7de0-4f79-8aab-dce56ba52871 for instance 24361d41-5ef8-4321-83a7-78a2343df7cf on hv-cinder-85031 Jul 21 06:33:13.858560 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-63d1bf0a-1481-48ae-928c-010b65c8775f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:13.859215 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-63d1bf0a-1481-48ae-928c-010b65c8775f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:13.863960 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-5645d384-f1b4-4f2e-ab60-ab4a725ed2d6 req-f7fbc608-8349-4e85-9b3a-3fcba4eb58cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064293 Jul 21 06:33:13.866125 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 223/445] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:13.896957 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e53e12ad-63db-42f2-8be0-127c161332bb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:13.898215 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e53e12ad-63db-42f2-8be0-127c161332bb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:13.907718 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e53e12ad-63db-42f2-8be0-127c161332bb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:13.909342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e53e12ad-63db-42f2-8be0-127c161332bb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:13.910895 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e53e12ad-63db-42f2-8be0-127c161332bb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:13.911520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e53e12ad-63db-42f2-8be0-127c161332bb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.112359 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-63d1bf0a-1481-48ae-928c-010b65c8775f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:14.122777 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-63d1bf0a-1481-48ae-928c-010b65c8775f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.303956 Jul 21 06:33:14.140228 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 223/446] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:13 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:14.144489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e53e12ad-63db-42f2-8be0-127c161332bb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:14.157293 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-bbaeca0d-ba24-4085-8fe6-eb3babdb94c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:14.157538 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e53e12ad-63db-42f2-8be0-127c161332bb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:14.158879 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-bbaeca0d-ba24-4085-8fe6-eb3babdb94c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:14.159277 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e53e12ad-63db-42f2-8be0-127c161332bb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:14.161429 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e53e12ad-63db-42f2-8be0-127c161332bb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1666 microversion: 2.20 time: 0.274879 Jul 21 06:33:14.162461 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 224/447] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:13 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1666 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:14.167317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-42ab6f35-699b-431f-95b6-a451c6009f93 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:14.167921 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-42ab6f35-699b-431f-95b6-a451c6009f93 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:14.181465 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bbaeca0d-ba24-4085-8fe6-eb3babdb94c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.185094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-42ab6f35-699b-431f-95b6-a451c6009f93 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.185094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-42ab6f35-699b-431f-95b6-a451c6009f93 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.186947 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bbaeca0d-ba24-4085-8fe6-eb3babdb94c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.187797 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bbaeca0d-ba24-4085-8fe6-eb3babdb94c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.188238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bbaeca0d-ba24-4085-8fe6-eb3babdb94c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.190522 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-42ab6f35-699b-431f-95b6-a451c6009f93 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.191686 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-42ab6f35-699b-431f-95b6-a451c6009f93 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.295264 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bbaeca0d-ba24-4085-8fe6-eb3babdb94c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:14.305198 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-bbaeca0d-ba24-4085-8fe6-eb3babdb94c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1299 microversion: 2.1 time: 0.158497 Jul 21 06:33:14.305796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 224/448] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:14 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1299 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:14.318967 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4744c661-59f1-4450-93f0-8a48cda7b728 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cf0d2bd-22fc-4294-b879-ed1f4a397563"}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:14.320085 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4744c661-59f1-4450-93f0-8a48cda7b728 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:14.326005 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4744c661-59f1-4450-93f0-8a48cda7b728 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.326454 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4744c661-59f1-4450-93f0-8a48cda7b728 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.327218 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4744c661-59f1-4450-93f0-8a48cda7b728 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.327655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4744c661-59f1-4450-93f0-8a48cda7b728 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.362884 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-42ab6f35-699b-431f-95b6-a451c6009f93 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:14.370814 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-42ab6f35-699b-431f-95b6-a451c6009f93 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.207185 Jul 21 06:33:14.371604 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 225/449] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:14 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:14.375909 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-093a0d23-3fa5-492c-9082-6a29453d9d45 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:14.376454 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-093a0d23-3fa5-492c-9082-6a29453d9d45 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:14.382880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-093a0d23-3fa5-492c-9082-6a29453d9d45 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.383343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-093a0d23-3fa5-492c-9082-6a29453d9d45 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.384125 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-093a0d23-3fa5-492c-9082-6a29453d9d45 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.384562 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-093a0d23-3fa5-492c-9082-6a29453d9d45 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.548066 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-093a0d23-3fa5-492c-9082-6a29453d9d45 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:14.558097 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-093a0d23-3fa5-492c-9082-6a29453d9d45 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.185634 Jul 21 06:33:14.561975 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 226/450] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:14 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:14.648845 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4744c661-59f1-4450-93f0-8a48cda7b728 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "POST /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341919 Jul 21 06:33:14.649472 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 225/451] 10.222.0.42 () {62 vars in 1363 bytes} [Thu Jul 21 06:33:14 2022] POST /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments => generated 188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:33:14.774073 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0ce28787-01d5-49eb-8d56-fb6d69938081 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:14.774638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0ce28787-01d5-49eb-8d56-fb6d69938081 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:14.781824 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ce28787-01d5-49eb-8d56-fb6d69938081 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.782317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ce28787-01d5-49eb-8d56-fb6d69938081 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.783102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ce28787-01d5-49eb-8d56-fb6d69938081 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.783533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ce28787-01d5-49eb-8d56-fb6d69938081 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.879798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0ce28787-01d5-49eb-8d56-fb6d69938081 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "POST /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/action" status: 202 len: 0 microversion: 2.20 time: 0.109956 Jul 21 06:33:14.880685 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 227/452] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jul 21 06:33:14 2022] POST /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 06:33:14.889611 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2d8f4e98-66f6-49b9-8b64-c7a315d220a3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:14.890370 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2d8f4e98-66f6-49b9-8b64-c7a315d220a3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:14.899453 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d8f4e98-66f6-49b9-8b64-c7a315d220a3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.904665 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d8f4e98-66f6-49b9-8b64-c7a315d220a3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:14.905626 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d8f4e98-66f6-49b9-8b64-c7a315d220a3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:14.906104 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2d8f4e98-66f6-49b9-8b64-c7a315d220a3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:15.106139 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2d8f4e98-66f6-49b9-8b64-c7a315d220a3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:15.115979 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2d8f4e98-66f6-49b9-8b64-c7a315d220a3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:15.117855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2d8f4e98-66f6-49b9-8b64-c7a315d220a3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:15.119263 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2d8f4e98-66f6-49b9-8b64-c7a315d220a3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1752 microversion: 2.20 time: 0.234045 Jul 21 06:33:15.120283 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 226/453] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:14 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1752 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:15.140572 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-09a2ad73-c95c-434a-9a81-2098acf177d9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:15.141448 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-09a2ad73-c95c-434a-9a81-2098acf177d9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:15.148431 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-09a2ad73-c95c-434a-9a81-2098acf177d9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:15.148911 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-09a2ad73-c95c-434a-9a81-2098acf177d9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:15.149686 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-09a2ad73-c95c-434a-9a81-2098acf177d9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:15.150155 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-09a2ad73-c95c-434a-9a81-2098acf177d9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:15.313299 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-09a2ad73-c95c-434a-9a81-2098acf177d9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:15.323208 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b9cc4ff3-0e60-4371-afad-a7a44c30d9a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:15.324351 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b9cc4ff3-0e60-4371-afad-a7a44c30d9a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:15.325683 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-09a2ad73-c95c-434a-9a81-2098acf177d9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.189026 Jul 21 06:33:15.326817 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 228/454] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:15 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:15.337512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9cc4ff3-0e60-4371-afad-a7a44c30d9a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:15.337512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9cc4ff3-0e60-4371-afad-a7a44c30d9a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:15.337512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9cc4ff3-0e60-4371-afad-a7a44c30d9a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:15.337512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9cc4ff3-0e60-4371-afad-a7a44c30d9a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:15.391598 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-659b46e7-1949-4327-9ebe-dde5694b954a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:15.392568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-659b46e7-1949-4327-9ebe-dde5694b954a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:15.403843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-659b46e7-1949-4327-9ebe-dde5694b954a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:15.404640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-659b46e7-1949-4327-9ebe-dde5694b954a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:15.405635 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-659b46e7-1949-4327-9ebe-dde5694b954a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:15.406358 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-659b46e7-1949-4327-9ebe-dde5694b954a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:15.540161 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b9cc4ff3-0e60-4371-afad-a7a44c30d9a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:15.548532 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b9cc4ff3-0e60-4371-afad-a7a44c30d9a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.230061 Jul 21 06:33:15.549440 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 227/455] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:15 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:15.575227 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4e0bea57-04fb-467c-bdb1-43e862c747fe tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:15.576343 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4e0bea57-04fb-467c-bdb1-43e862c747fe tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:15.585058 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4e0bea57-04fb-467c-bdb1-43e862c747fe tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:15.588244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4e0bea57-04fb-467c-bdb1-43e862c747fe tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:15.589310 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4e0bea57-04fb-467c-bdb1-43e862c747fe tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:15.589756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4e0bea57-04fb-467c-bdb1-43e862c747fe tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:15.694393 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-659b46e7-1949-4327-9ebe-dde5694b954a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:15.708528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-659b46e7-1949-4327-9ebe-dde5694b954a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.317594 Jul 21 06:33:15.709368 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 229/456] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:15 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:15.783277 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4e0bea57-04fb-467c-bdb1-43e862c747fe tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:15.792591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4e0bea57-04fb-467c-bdb1-43e862c747fe tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.221166 Jul 21 06:33:15.793430 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 228/457] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:15 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:15.884690 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-462dd4c3-1531-4d1a-b180-ce1b1b038ddb req-0e96d0ea-2939-4bb0-94ed-31c3df8b47f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c3a3de3-c6af-4f50-b999-d47265b43595", "tag": "ec590c24-0627-4416-8dda-da4d559e2b05"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:15.896711 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-462dd4c3-1531-4d1a-b180-ce1b1b038ddb req-0e96d0ea-2939-4bb0-94ed-31c3df8b47f8 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:15.897111 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-462dd4c3-1531-4d1a-b180-ce1b1b038ddb req-0e96d0ea-2939-4bb0-94ed-31c3df8b47f8 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:15.909266 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-462dd4c3-1531-4d1a-b180-ce1b1b038ddb req-0e96d0ea-2939-4bb0-94ed-31c3df8b47f8 service nova] Creating event network-changed:ec590c24-0627-4416-8dda-da4d559e2b05 for instance 3c3a3de3-c6af-4f50-b999-d47265b43595 on hv-cinder-85031 Jul 21 06:33:15.915222 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-462dd4c3-1531-4d1a-b180-ce1b1b038ddb req-0e96d0ea-2939-4bb0-94ed-31c3df8b47f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034284 Jul 21 06:33:15.915841 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 230/458] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:33:16.137850 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-47be286f-597c-47c1-bac4-d834cd628afc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:16.138999 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-47be286f-597c-47c1-bac4-d834cd628afc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:16.152178 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-47be286f-597c-47c1-bac4-d834cd628afc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:16.152545 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-47be286f-597c-47c1-bac4-d834cd628afc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:16.153511 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-47be286f-597c-47c1-bac4-d834cd628afc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:16.153967 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-47be286f-597c-47c1-bac4-d834cd628afc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:16.345550 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ef13e492-edb8-48af-96db-59347ddc749f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:16.346288 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ef13e492-edb8-48af-96db-59347ddc749f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:16.362316 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef13e492-edb8-48af-96db-59347ddc749f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:16.364745 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef13e492-edb8-48af-96db-59347ddc749f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:16.365884 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef13e492-edb8-48af-96db-59347ddc749f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:16.366508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef13e492-edb8-48af-96db-59347ddc749f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:16.664788 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-47be286f-597c-47c1-bac4-d834cd628afc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:16.678444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-47be286f-597c-47c1-bac4-d834cd628afc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:16.681324 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ef13e492-edb8-48af-96db-59347ddc749f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:16.688833 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-47be286f-597c-47c1-bac4-d834cd628afc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:16.690757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-47be286f-597c-47c1-bac4-d834cd628afc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1752 microversion: 2.20 time: 0.556761 Jul 21 06:33:16.692159 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 229/459] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:16 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1752 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:16.694307 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ef13e492-edb8-48af-96db-59347ddc749f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.352807 Jul 21 06:33:16.694963 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 231/460] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:16 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:16.698499 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7d79145a-7a3b-48b0-a872-e809ccd51ad6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:16.699258 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7d79145a-7a3b-48b0-a872-e809ccd51ad6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:16.705266 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d79145a-7a3b-48b0-a872-e809ccd51ad6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:16.705723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d79145a-7a3b-48b0-a872-e809ccd51ad6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:16.706582 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d79145a-7a3b-48b0-a872-e809ccd51ad6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:16.707944 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d79145a-7a3b-48b0-a872-e809ccd51ad6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:16.727085 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-370f253c-dd98-4a0c-ac59-6f1d6a21c44c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:16.731766 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-370f253c-dd98-4a0c-ac59-6f1d6a21c44c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:16.739732 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-370f253c-dd98-4a0c-ac59-6f1d6a21c44c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:16.740535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-370f253c-dd98-4a0c-ac59-6f1d6a21c44c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:16.741531 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-370f253c-dd98-4a0c-ac59-6f1d6a21c44c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:16.742205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-370f253c-dd98-4a0c-ac59-6f1d6a21c44c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:16.951122 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7d79145a-7a3b-48b0-a872-e809ccd51ad6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:16.964229 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7d79145a-7a3b-48b0-a872-e809ccd51ad6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.270331 Jul 21 06:33:16.964819 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 230/461] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:16 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:16.981144 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-83c22277-b15a-451d-bbf2-1f0dea26ef61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:16.981760 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-83c22277-b15a-451d-bbf2-1f0dea26ef61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:16.990080 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-83c22277-b15a-451d-bbf2-1f0dea26ef61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:16.990604 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-83c22277-b15a-451d-bbf2-1f0dea26ef61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:16.991359 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-83c22277-b15a-451d-bbf2-1f0dea26ef61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:16.991848 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-83c22277-b15a-451d-bbf2-1f0dea26ef61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:16.993496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-370f253c-dd98-4a0c-ac59-6f1d6a21c44c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:17.003456 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-370f253c-dd98-4a0c-ac59-6f1d6a21c44c tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.281768 Jul 21 06:33:17.004956 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 232/462] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:16 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:17.056709 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:17.080173 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=10 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:17.139638 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-83c22277-b15a-451d-bbf2-1f0dea26ef61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:17.149811 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-83c22277-b15a-451d-bbf2-1f0dea26ef61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.181676 Jul 21 06:33:17.149811 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 231/463] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:16 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:17.713469 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-76dfaf2d-e666-4f91-9a8e-9bc6f1d032e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:17.714142 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-76dfaf2d-e666-4f91-9a8e-9bc6f1d032e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:17.715042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e5dcf603-bafe-49c1-a04c-13afc745138a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:17.716174 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e5dcf603-bafe-49c1-a04c-13afc745138a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:17.718528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:17.720008 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=6 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:17.723749 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76dfaf2d-e666-4f91-9a8e-9bc6f1d032e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:17.724916 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76dfaf2d-e666-4f91-9a8e-9bc6f1d032e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:17.725038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76dfaf2d-e666-4f91-9a8e-9bc6f1d032e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:17.725397 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76dfaf2d-e666-4f91-9a8e-9bc6f1d032e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:17.728186 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e5dcf603-bafe-49c1-a04c-13afc745138a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:17.728873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e5dcf603-bafe-49c1-a04c-13afc745138a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:17.731311 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e5dcf603-bafe-49c1-a04c-13afc745138a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:17.731994 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e5dcf603-bafe-49c1-a04c-13afc745138a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:17.983555 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e5dcf603-bafe-49c1-a04c-13afc745138a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:17.992107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-76dfaf2d-e666-4f91-9a8e-9bc6f1d032e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:17.996823 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e5dcf603-bafe-49c1-a04c-13afc745138a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:17.998480 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e5dcf603-bafe-49c1-a04c-13afc745138a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:17.999793 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e5dcf603-bafe-49c1-a04c-13afc745138a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1754 microversion: 2.20 time: 0.291401 Jul 21 06:33:18.010010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 233/464] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:17 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1754 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:18.010010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7a8fc240-9fac-437c-8358-51e1fa16e1e8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:18.010010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7a8fc240-9fac-437c-8358-51e1fa16e1e8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:18.013132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a8fc240-9fac-437c-8358-51e1fa16e1e8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:18.013132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a8fc240-9fac-437c-8358-51e1fa16e1e8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:18.013934 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a8fc240-9fac-437c-8358-51e1fa16e1e8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:18.014404 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a8fc240-9fac-437c-8358-51e1fa16e1e8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:18.017303 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-76dfaf2d-e666-4f91-9a8e-9bc6f1d032e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.307819 Jul 21 06:33:18.018264 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 232/465] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:17 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:18.036647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-329dc7f5-d3d3-437d-9e0e-fccc5d7fb78e tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:18.038894 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-329dc7f5-d3d3-437d-9e0e-fccc5d7fb78e tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:18.049255 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-329dc7f5-d3d3-437d-9e0e-fccc5d7fb78e tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:18.052391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-329dc7f5-d3d3-437d-9e0e-fccc5d7fb78e tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:18.053172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-329dc7f5-d3d3-437d-9e0e-fccc5d7fb78e tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:18.053617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-329dc7f5-d3d3-437d-9e0e-fccc5d7fb78e tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:18.228535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7a8fc240-9fac-437c-8358-51e1fa16e1e8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:18.231940 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-329dc7f5-d3d3-437d-9e0e-fccc5d7fb78e tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:18.238768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7a8fc240-9fac-437c-8358-51e1fa16e1e8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.236440 Jul 21 06:33:18.239533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 234/466] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:18 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:18.244526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ee5cf92a-a110-4ae4-8872-80433d3f93d7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:18.245141 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ee5cf92a-a110-4ae4-8872-80433d3f93d7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:18.248959 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-329dc7f5-d3d3-437d-9e0e-fccc5d7fb78e tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.229359 Jul 21 06:33:18.250371 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 233/467] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:18 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:18.251751 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ee5cf92a-a110-4ae4-8872-80433d3f93d7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:18.252274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ee5cf92a-a110-4ae4-8872-80433d3f93d7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:18.253090 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ee5cf92a-a110-4ae4-8872-80433d3f93d7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:18.253559 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ee5cf92a-a110-4ae4-8872-80433d3f93d7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:18.392101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ee5cf92a-a110-4ae4-8872-80433d3f93d7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:18.401083 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ee5cf92a-a110-4ae4-8872-80433d3f93d7 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.160339 Jul 21 06:33:18.401682 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 235/468] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:18 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:18.448507 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-b0637b03-4aef-4ab2-9a31-31784988ab29 req-72f0f8c7-52d6-4916-88ec-04e888136e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd12a96-a6ba-4881-9e69-20771a9b2d91", "name": "network-vif-plugged", "status": "completed", "tag": "30a8386c-e7fc-4d12-86c3-922716884c6e"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:18.457363 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-b0637b03-4aef-4ab2-9a31-31784988ab29 req-72f0f8c7-52d6-4916-88ec-04e888136e74 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:18.457889 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-b0637b03-4aef-4ab2-9a31-31784988ab29 req-72f0f8c7-52d6-4916-88ec-04e888136e74 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:18.470448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-b0637b03-4aef-4ab2-9a31-31784988ab29 req-72f0f8c7-52d6-4916-88ec-04e888136e74 service nova] Creating event network-vif-plugged:30a8386c-e7fc-4d12-86c3-922716884c6e for instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 on hv-cinder-85031 Jul 21 06:33:18.476294 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-b0637b03-4aef-4ab2-9a31-31784988ab29 req-72f0f8c7-52d6-4916-88ec-04e888136e74 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031436 Jul 21 06:33:18.476974 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 234/469] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:19.020581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-aab52abb-ff56-40e9-9ad9-dd818636ec71 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:19.021188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-aab52abb-ff56-40e9-9ad9-dd818636ec71 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:19.027981 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aab52abb-ff56-40e9-9ad9-dd818636ec71 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:19.028726 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aab52abb-ff56-40e9-9ad9-dd818636ec71 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:19.029852 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aab52abb-ff56-40e9-9ad9-dd818636ec71 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:19.030114 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aab52abb-ff56-40e9-9ad9-dd818636ec71 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:19.049359 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ada84409-7143-40d3-8fb9-d4106d327f2e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:19.051125 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ada84409-7143-40d3-8fb9-d4106d327f2e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:19.067485 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ada84409-7143-40d3-8fb9-d4106d327f2e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:19.068946 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ada84409-7143-40d3-8fb9-d4106d327f2e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:19.069995 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ada84409-7143-40d3-8fb9-d4106d327f2e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:19.070768 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ada84409-7143-40d3-8fb9-d4106d327f2e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:19.091154 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:19.248086 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-aab52abb-ff56-40e9-9ad9-dd818636ec71 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:19.251922 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ada84409-7143-40d3-8fb9-d4106d327f2e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:19.258673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-aab52abb-ff56-40e9-9ad9-dd818636ec71 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:19.260985 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-aab52abb-ff56-40e9-9ad9-dd818636ec71 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:19.262460 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-aab52abb-ff56-40e9-9ad9-dd818636ec71 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1754 microversion: 2.20 time: 0.245764 Jul 21 06:33:19.262620 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ada84409-7143-40d3-8fb9-d4106d327f2e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.226889 Jul 21 06:33:19.263112 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 236/470] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:19 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1754 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:19.263554 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 235/471] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:19 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:19.267884 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-cd47a30c-bf01-428f-91cf-1b55fe1bad0b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:19.268178 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2464a12a-dfc1-4ff7-9f19-f5951087892b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:19.268496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-cd47a30c-bf01-428f-91cf-1b55fe1bad0b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:19.268791 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2464a12a-dfc1-4ff7-9f19-f5951087892b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:19.276212 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2464a12a-dfc1-4ff7-9f19-f5951087892b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:19.276660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2464a12a-dfc1-4ff7-9f19-f5951087892b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:19.277618 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2464a12a-dfc1-4ff7-9f19-f5951087892b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:19.278253 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2464a12a-dfc1-4ff7-9f19-f5951087892b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:19.281411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cd47a30c-bf01-428f-91cf-1b55fe1bad0b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:19.282021 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cd47a30c-bf01-428f-91cf-1b55fe1bad0b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:19.283273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cd47a30c-bf01-428f-91cf-1b55fe1bad0b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:19.283949 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cd47a30c-bf01-428f-91cf-1b55fe1bad0b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:19.480630 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2464a12a-dfc1-4ff7-9f19-f5951087892b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:19.483723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-cd47a30c-bf01-428f-91cf-1b55fe1bad0b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:19.488508 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2464a12a-dfc1-4ff7-9f19-f5951087892b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.223860 Jul 21 06:33:19.489064 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 236/472] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:19 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:19.493742 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-13c6a700-f40a-47a2-9960-b0609ba2a838 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:19.494492 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-13c6a700-f40a-47a2-9960-b0609ba2a838 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:19.498849 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-cd47a30c-bf01-428f-91cf-1b55fe1bad0b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.234509 Jul 21 06:33:19.499418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 237/473] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:19 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:19.500543 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13c6a700-f40a-47a2-9960-b0609ba2a838 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:19.501030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13c6a700-f40a-47a2-9960-b0609ba2a838 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:19.501799 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13c6a700-f40a-47a2-9960-b0609ba2a838 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:19.502294 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13c6a700-f40a-47a2-9960-b0609ba2a838 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:19.636009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-13c6a700-f40a-47a2-9960-b0609ba2a838 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:19.643508 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-13c6a700-f40a-47a2-9960-b0609ba2a838 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.153281 Jul 21 06:33:19.644024 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 237/474] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:19 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:20.279869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5e07e4c0-c2e1-404d-856b-dbfbfe4d4f91 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:20.280513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5e07e4c0-c2e1-404d-856b-dbfbfe4d4f91 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:20.287685 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5e07e4c0-c2e1-404d-856b-dbfbfe4d4f91 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:20.288203 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5e07e4c0-c2e1-404d-856b-dbfbfe4d4f91 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:20.289046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5e07e4c0-c2e1-404d-856b-dbfbfe4d4f91 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:20.289542 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5e07e4c0-c2e1-404d-856b-dbfbfe4d4f91 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:20.291538 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-765e51aa-e91e-4f8b-8364-84b353663aa3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:20.292148 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-765e51aa-e91e-4f8b-8364-84b353663aa3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:20.294077 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:20.299153 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-765e51aa-e91e-4f8b-8364-84b353663aa3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:20.299601 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-765e51aa-e91e-4f8b-8364-84b353663aa3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:20.301000 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-765e51aa-e91e-4f8b-8364-84b353663aa3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:20.301924 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-765e51aa-e91e-4f8b-8364-84b353663aa3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:20.485361 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5e07e4c0-c2e1-404d-856b-dbfbfe4d4f91 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:20.491468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-765e51aa-e91e-4f8b-8364-84b353663aa3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:20.494775 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5e07e4c0-c2e1-404d-856b-dbfbfe4d4f91 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.218691 Jul 21 06:33:20.495361 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 238/475] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:20 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:20.499913 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-765e51aa-e91e-4f8b-8364-84b353663aa3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:20.501438 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-765e51aa-e91e-4f8b-8364-84b353663aa3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:20.502648 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-765e51aa-e91e-4f8b-8364-84b353663aa3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1754 microversion: 2.20 time: 0.215211 Jul 21 06:33:20.503197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 238/476] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:20 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1754 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:20.507205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-88f1c49c-b6c2-45d6-89b3-ba2987e84f15 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:20.507947 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-88f1c49c-b6c2-45d6-89b3-ba2987e84f15 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:20.514213 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-88f1c49c-b6c2-45d6-89b3-ba2987e84f15 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:20.514672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-88f1c49c-b6c2-45d6-89b3-ba2987e84f15 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:20.515438 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-88f1c49c-b6c2-45d6-89b3-ba2987e84f15 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:20.515673 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-41c09ea8-a323-47de-8317-e5f168ce45cd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:20.515874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-88f1c49c-b6c2-45d6-89b3-ba2987e84f15 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:20.516286 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-41c09ea8-a323-47de-8317-e5f168ce45cd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:20.523005 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41c09ea8-a323-47de-8317-e5f168ce45cd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:20.523462 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41c09ea8-a323-47de-8317-e5f168ce45cd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:20.524232 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41c09ea8-a323-47de-8317-e5f168ce45cd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:20.524673 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41c09ea8-a323-47de-8317-e5f168ce45cd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:20.713600 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-88f1c49c-b6c2-45d6-89b3-ba2987e84f15 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:20.720374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-41c09ea8-a323-47de-8317-e5f168ce45cd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:20.721221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-88f1c49c-b6c2-45d6-89b3-ba2987e84f15 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.217824 Jul 21 06:33:20.721867 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 239/477] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:20 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:20.727493 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-06c24aab-e17f-4beb-b4cd-3ac074dca3d5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:20.728162 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-06c24aab-e17f-4beb-b4cd-3ac074dca3d5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:20.728478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-41c09ea8-a323-47de-8317-e5f168ce45cd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.216379 Jul 21 06:33:20.729051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 239/478] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:20 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:20.734681 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-06c24aab-e17f-4beb-b4cd-3ac074dca3d5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:20.735140 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-06c24aab-e17f-4beb-b4cd-3ac074dca3d5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:20.735913 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-06c24aab-e17f-4beb-b4cd-3ac074dca3d5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:20.736355 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-06c24aab-e17f-4beb-b4cd-3ac074dca3d5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:20.867216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-06c24aab-e17f-4beb-b4cd-3ac074dca3d5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:20.874730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-06c24aab-e17f-4beb-b4cd-3ac074dca3d5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.150603 Jul 21 06:33:20.875293 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 240/479] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:20 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:21.512348 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-898f0c63-07da-4d2c-859a-567bef18c069 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:21.512985 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-898f0c63-07da-4d2c-859a-567bef18c069 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:21.520059 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-898f0c63-07da-4d2c-859a-567bef18c069 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:21.520505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-898f0c63-07da-4d2c-859a-567bef18c069 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:21.521218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f367d746-5c5a-438e-86e9-91bd13276335 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:21.521625 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-898f0c63-07da-4d2c-859a-567bef18c069 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:21.521719 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-898f0c63-07da-4d2c-859a-567bef18c069 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:21.521837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f367d746-5c5a-438e-86e9-91bd13276335 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:21.528492 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f367d746-5c5a-438e-86e9-91bd13276335 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:21.528938 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f367d746-5c5a-438e-86e9-91bd13276335 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:21.529717 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f367d746-5c5a-438e-86e9-91bd13276335 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:21.530178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f367d746-5c5a-438e-86e9-91bd13276335 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:21.718010 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-898f0c63-07da-4d2c-859a-567bef18c069 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:21.721872 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f367d746-5c5a-438e-86e9-91bd13276335 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:21.726107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-898f0c63-07da-4d2c-859a-567bef18c069 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1722 microversion: 2.1 time: 0.217682 Jul 21 06:33:21.726690 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 240/480] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:21 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:21.730752 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f367d746-5c5a-438e-86e9-91bd13276335 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:21.732241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f367d746-5c5a-438e-86e9-91bd13276335 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:21.733385 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f367d746-5c5a-438e-86e9-91bd13276335 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1754 microversion: 2.20 time: 0.216804 Jul 21 06:33:21.734223 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 241/481] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:21 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:21.738842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d238fe43-1970-403f-8cfb-6031e6c030c0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:21.739461 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d238fe43-1970-403f-8cfb-6031e6c030c0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:21.744372 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7f1fbd39-b5dd-49a5-93ac-992522544ec7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:21.745115 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7f1fbd39-b5dd-49a5-93ac-992522544ec7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:21.745557 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d238fe43-1970-403f-8cfb-6031e6c030c0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:21.746037 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d238fe43-1970-403f-8cfb-6031e6c030c0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:21.746807 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d238fe43-1970-403f-8cfb-6031e6c030c0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:21.747241 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d238fe43-1970-403f-8cfb-6031e6c030c0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:21.747879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:21.751582 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f1fbd39-b5dd-49a5-93ac-992522544ec7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:21.752029 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f1fbd39-b5dd-49a5-93ac-992522544ec7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:21.752789 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f1fbd39-b5dd-49a5-93ac-992522544ec7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:21.753221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f1fbd39-b5dd-49a5-93ac-992522544ec7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:21.944523 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d238fe43-1970-403f-8cfb-6031e6c030c0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:21.947536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7f1fbd39-b5dd-49a5-93ac-992522544ec7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:21.952033 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d238fe43-1970-403f-8cfb-6031e6c030c0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.216910 Jul 21 06:33:21.952601 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 241/482] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:21 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:21.957259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7f1fbd39-b5dd-49a5-93ac-992522544ec7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.216287 Jul 21 06:33:21.957418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5a4dd869-092d-4482-805f-6215da68133a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:21.958132 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5a4dd869-092d-4482-805f-6215da68133a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:21.958289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 242/483] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:21 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:21.963828 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5a4dd869-092d-4482-805f-6215da68133a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:21.964263 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5a4dd869-092d-4482-805f-6215da68133a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:21.965022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5a4dd869-092d-4482-805f-6215da68133a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:21.965451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5a4dd869-092d-4482-805f-6215da68133a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:22.096473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5a4dd869-092d-4482-805f-6215da68133a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:22.104935 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5a4dd869-092d-4482-805f-6215da68133a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.151321 Jul 21 06:33:22.105437 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 242/484] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:21 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:22.666227 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-e737418d-8595-4973-b855-6d4f1699fc79 req-26bac7c9-f79a-4360-9353-4e0a97ae8993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24361d41-5ef8-4321-83a7-78a2343df7cf", "name": "network-vif-plugged", "status": "completed", "tag": "f8ba934b-7de0-4f79-8aab-dce56ba52871"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:22.675412 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-e737418d-8595-4973-b855-6d4f1699fc79 req-26bac7c9-f79a-4360-9353-4e0a97ae8993 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:22.676183 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-e737418d-8595-4973-b855-6d4f1699fc79 req-26bac7c9-f79a-4360-9353-4e0a97ae8993 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:22.688552 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-e737418d-8595-4973-b855-6d4f1699fc79 req-26bac7c9-f79a-4360-9353-4e0a97ae8993 service nova] Creating event network-vif-plugged:f8ba934b-7de0-4f79-8aab-dce56ba52871 for instance 24361d41-5ef8-4321-83a7-78a2343df7cf on hv-cinder-85031 Jul 21 06:33:22.694593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-e737418d-8595-4973-b855-6d4f1699fc79 req-26bac7c9-f79a-4360-9353-4e0a97ae8993 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031894 Jul 21 06:33:22.695241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 243/485] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:22.743852 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-334bbd53-203b-4e0c-8ede-d518ceecdb5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:22.744467 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-334bbd53-203b-4e0c-8ede-d518ceecdb5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:22.751004 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-334bbd53-203b-4e0c-8ede-d518ceecdb5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:22.751458 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-334bbd53-203b-4e0c-8ede-d518ceecdb5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:22.752129 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c32d55a9-55f9-4fa2-abc4-3d78eb6aeec5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:22.752253 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-334bbd53-203b-4e0c-8ede-d518ceecdb5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:22.752646 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-334bbd53-203b-4e0c-8ede-d518ceecdb5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:22.752892 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c32d55a9-55f9-4fa2-abc4-3d78eb6aeec5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:22.759508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c32d55a9-55f9-4fa2-abc4-3d78eb6aeec5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:22.759878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c32d55a9-55f9-4fa2-abc4-3d78eb6aeec5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:22.760648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c32d55a9-55f9-4fa2-abc4-3d78eb6aeec5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:22.761086 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c32d55a9-55f9-4fa2-abc4-3d78eb6aeec5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:22.944987 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-334bbd53-203b-4e0c-8ede-d518ceecdb5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:22.951710 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c32d55a9-55f9-4fa2-abc4-3d78eb6aeec5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:22.952910 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-334bbd53-203b-4e0c-8ede-d518ceecdb5d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1699 microversion: 2.1 time: 0.212873 Jul 21 06:33:22.953822 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 243/486] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:22 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1699 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:22.961047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c32d55a9-55f9-4fa2-abc4-3d78eb6aeec5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:22.962595 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c32d55a9-55f9-4fa2-abc4-3d78eb6aeec5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:22.963757 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c32d55a9-55f9-4fa2-abc4-3d78eb6aeec5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.216080 Jul 21 06:33:22.964438 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 244/487] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:22 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:22.968286 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6a7d660b-afac-4fc6-a720-a5f2300c55bb tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:22.968907 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6a7d660b-afac-4fc6-a720-a5f2300c55bb tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:22.974350 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e4becc5b-7b79-46ec-ba12-f0eb3bcf1c67 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:22.975930 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a7d660b-afac-4fc6-a720-a5f2300c55bb tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:22.976384 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a7d660b-afac-4fc6-a720-a5f2300c55bb tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:22.977160 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a7d660b-afac-4fc6-a720-a5f2300c55bb tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:22.977594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a7d660b-afac-4fc6-a720-a5f2300c55bb tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:22.980125 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e4becc5b-7b79-46ec-ba12-f0eb3bcf1c67 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:22.980571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e4becc5b-7b79-46ec-ba12-f0eb3bcf1c67 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:23.040139 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e4becc5b-7b79-46ec-ba12-f0eb3bcf1c67 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Going to try to start instance {{(pid=117906) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 06:33:23.082553 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e4becc5b-7b79-46ec-ba12-f0eb3bcf1c67 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/action" status: 202 len: 0 microversion: 2.1 time: 0.111927 Jul 21 06:33:23.083189 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 245/488] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:33:22 2022] POST /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:33:23.088761 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1f6b017e-aa82-4bbb-a6d1-96f8263f7577 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:23.089469 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1f6b017e-aa82-4bbb-a6d1-96f8263f7577 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:23.095770 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1f6b017e-aa82-4bbb-a6d1-96f8263f7577 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:23.096215 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1f6b017e-aa82-4bbb-a6d1-96f8263f7577 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:23.096973 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1f6b017e-aa82-4bbb-a6d1-96f8263f7577 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:23.098067 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1f6b017e-aa82-4bbb-a6d1-96f8263f7577 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:23.118197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6a7d660b-afac-4fc6-a720-a5f2300c55bb tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:23.126205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6a7d660b-afac-4fc6-a720-a5f2300c55bb tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.161602 Jul 21 06:33:23.127356 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 244/489] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:22 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:23.132719 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-cc1e8782-6e47-4066-9db1-0de721f440e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:23.133507 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-cc1e8782-6e47-4066-9db1-0de721f440e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:23.139651 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc1e8782-6e47-4066-9db1-0de721f440e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:23.140098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc1e8782-6e47-4066-9db1-0de721f440e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:23.140861 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc1e8782-6e47-4066-9db1-0de721f440e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:23.141295 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc1e8782-6e47-4066-9db1-0de721f440e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:23.298313 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1f6b017e-aa82-4bbb-a6d1-96f8263f7577 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:23.306602 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1f6b017e-aa82-4bbb-a6d1-96f8263f7577 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.222152 Jul 21 06:33:23.307182 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 246/490] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:23 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:23.311924 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b097f206-866b-4e00-bf2e-c592adf3710f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:23.312536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b097f206-866b-4e00-bf2e-c592adf3710f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:23.319302 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b097f206-866b-4e00-bf2e-c592adf3710f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:23.319757 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b097f206-866b-4e00-bf2e-c592adf3710f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:23.320533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b097f206-866b-4e00-bf2e-c592adf3710f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:23.320969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b097f206-866b-4e00-bf2e-c592adf3710f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:23.324928 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-cc1e8782-6e47-4066-9db1-0de721f440e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:23.334156 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-cc1e8782-6e47-4066-9db1-0de721f440e9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1708 microversion: 2.1 time: 0.205549 Jul 21 06:33:23.335057 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 245/491] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:23 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1708 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:23.507901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b097f206-866b-4e00-bf2e-c592adf3710f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:23.517115 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b097f206-866b-4e00-bf2e-c592adf3710f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1266 microversion: 2.1 time: 0.208580 Jul 21 06:33:23.517677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 247/492] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:23 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:23.982687 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3cfaf035-f4a8-4491-a541-e3173595e0d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:23.983298 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3cfaf035-f4a8-4491-a541-e3173595e0d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:23.990141 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3cfaf035-f4a8-4491-a541-e3173595e0d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:23.990593 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3cfaf035-f4a8-4491-a541-e3173595e0d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:23.991378 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3cfaf035-f4a8-4491-a541-e3173595e0d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:23.991813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3cfaf035-f4a8-4491-a541-e3173595e0d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.121727 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3cfaf035-f4a8-4491-a541-e3173595e0d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:24.130902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3cfaf035-f4a8-4491-a541-e3173595e0d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:24.132427 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3cfaf035-f4a8-4491-a541-e3173595e0d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:24.133593 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3cfaf035-f4a8-4491-a541-e3173595e0d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.154768 Jul 21 06:33:24.134194 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 246/493] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:23 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:24.143446 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ec9b09cc-5b98-4002-83de-8b049d3cbdec tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:24.144093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ec9b09cc-5b98-4002-83de-8b049d3cbdec tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:24.150945 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec9b09cc-5b98-4002-83de-8b049d3cbdec tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:24.151401 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec9b09cc-5b98-4002-83de-8b049d3cbdec tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.152169 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec9b09cc-5b98-4002-83de-8b049d3cbdec tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:24.152605 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec9b09cc-5b98-4002-83de-8b049d3cbdec tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.287121 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ec9b09cc-5b98-4002-83de-8b049d3cbdec tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:24.295267 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ec9b09cc-5b98-4002-83de-8b049d3cbdec tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.155614 Jul 21 06:33:24.295864 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 248/494] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:24 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:24.324761 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d4eaeff0-8936-4077-b355-c12fd112475e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:24.325297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d4eaeff0-8936-4077-b355-c12fd112475e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:24.333001 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d4eaeff0-8936-4077-b355-c12fd112475e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:24.333486 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d4eaeff0-8936-4077-b355-c12fd112475e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.335041 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d4eaeff0-8936-4077-b355-c12fd112475e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:24.335604 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d4eaeff0-8936-4077-b355-c12fd112475e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.355975 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-109f1a8b-de7c-4553-b9f3-04da03d711f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:24.356972 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-109f1a8b-de7c-4553-b9f3-04da03d711f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:24.364467 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-109f1a8b-de7c-4553-b9f3-04da03d711f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:24.365232 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-109f1a8b-de7c-4553-b9f3-04da03d711f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.366257 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-109f1a8b-de7c-4553-b9f3-04da03d711f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:24.366907 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-109f1a8b-de7c-4553-b9f3-04da03d711f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.584643 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d4eaeff0-8936-4077-b355-c12fd112475e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:24.590576 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-109f1a8b-de7c-4553-b9f3-04da03d711f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:24.593902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d4eaeff0-8936-4077-b355-c12fd112475e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.273675 Jul 21 06:33:24.599500 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-109f1a8b-de7c-4553-b9f3-04da03d711f8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1708 microversion: 2.1 time: 0.250995 Jul 21 06:33:24.600329 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 249/495] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:24 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1708 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:24.603321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 247/496] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:24 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:24.613961 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-474230c3-156a-491e-9ce4-6b71e80a2f5f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:24.614651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-474230c3-156a-491e-9ce4-6b71e80a2f5f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:24.620951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-474230c3-156a-491e-9ce4-6b71e80a2f5f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:24.621400 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-474230c3-156a-491e-9ce4-6b71e80a2f5f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.622185 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-474230c3-156a-491e-9ce4-6b71e80a2f5f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:24.622618 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-474230c3-156a-491e-9ce4-6b71e80a2f5f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.819476 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-474230c3-156a-491e-9ce4-6b71e80a2f5f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:24.827031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-474230c3-156a-491e-9ce4-6b71e80a2f5f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1454 microversion: 2.1 time: 0.221201 Jul 21 06:33:24.827603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 250/497] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:24 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1454 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:24.844162 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2f1e8e38-3e00-4bde-8315-31cbcea9358f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:24.844706 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2f1e8e38-3e00-4bde-8315-31cbcea9358f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:24.851179 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2f1e8e38-3e00-4bde-8315-31cbcea9358f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:24.851625 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2f1e8e38-3e00-4bde-8315-31cbcea9358f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.852383 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2f1e8e38-3e00-4bde-8315-31cbcea9358f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:24.852828 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2f1e8e38-3e00-4bde-8315-31cbcea9358f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:24.985583 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2f1e8e38-3e00-4bde-8315-31cbcea9358f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:24.994145 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2f1e8e38-3e00-4bde-8315-31cbcea9358f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1454 microversion: 2.1 time: 0.153784 Jul 21 06:33:24.994813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 248/498] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:24 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:25.153281 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e6ccfb83-b42c-49e6-a807-398f3e83c979 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:25.154164 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e6ccfb83-b42c-49e6-a807-398f3e83c979 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:25.161744 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e6ccfb83-b42c-49e6-a807-398f3e83c979 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:25.162357 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e6ccfb83-b42c-49e6-a807-398f3e83c979 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:25.163309 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e6ccfb83-b42c-49e6-a807-398f3e83c979 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:25.164041 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e6ccfb83-b42c-49e6-a807-398f3e83c979 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:25.315970 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-08e37c36-ed2e-4974-b71b-49ae719a30d0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:25.317424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-08e37c36-ed2e-4974-b71b-49ae719a30d0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:25.324996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-08e37c36-ed2e-4974-b71b-49ae719a30d0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:25.325508 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-08e37c36-ed2e-4974-b71b-49ae719a30d0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:25.326467 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-08e37c36-ed2e-4974-b71b-49ae719a30d0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:25.326963 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-08e37c36-ed2e-4974-b71b-49ae719a30d0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:25.500782 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e6ccfb83-b42c-49e6-a807-398f3e83c979 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:25.511168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e6ccfb83-b42c-49e6-a807-398f3e83c979 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:25.513519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e6ccfb83-b42c-49e6-a807-398f3e83c979 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:25.514782 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e6ccfb83-b42c-49e6-a807-398f3e83c979 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.365776 Jul 21 06:33:25.515571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 251/499] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:25 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:25.610969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-83f4fe8e-30ef-468b-91d5-76d800e9cefa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:25.611865 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-83f4fe8e-30ef-468b-91d5-76d800e9cefa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:25.617964 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-83f4fe8e-30ef-468b-91d5-76d800e9cefa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:25.618435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-83f4fe8e-30ef-468b-91d5-76d800e9cefa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:25.619194 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-83f4fe8e-30ef-468b-91d5-76d800e9cefa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:25.619632 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-83f4fe8e-30ef-468b-91d5-76d800e9cefa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:25.665234 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-08e37c36-ed2e-4974-b71b-49ae719a30d0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:25.672569 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-08e37c36-ed2e-4974-b71b-49ae719a30d0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1315 microversion: 2.1 time: 0.361562 Jul 21 06:33:25.673137 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 249/500] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:25 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:25.687080 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7d13789c-89cd-4300-adc2-576804eff834 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:25.687687 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7d13789c-89cd-4300-adc2-576804eff834 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:25.694554 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d13789c-89cd-4300-adc2-576804eff834 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:25.694819 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d13789c-89cd-4300-adc2-576804eff834 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:25.695621 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d13789c-89cd-4300-adc2-576804eff834 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:25.696305 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d13789c-89cd-4300-adc2-576804eff834 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:26.153060 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-83f4fe8e-30ef-468b-91d5-76d800e9cefa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:26.162679 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-83f4fe8e-30ef-468b-91d5-76d800e9cefa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.555643 Jul 21 06:33:26.163311 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 252/501] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:25 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:26.199250 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7d13789c-89cd-4300-adc2-576804eff834 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:26.209902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7d13789c-89cd-4300-adc2-576804eff834 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1708 microversion: 2.1 time: 0.529018 Jul 21 06:33:26.211469 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 250/502] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:25 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1708 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:26.536791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d0667a4e-9dc2-4bdd-b952-bbccde173ca6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:26.537658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d0667a4e-9dc2-4bdd-b952-bbccde173ca6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:26.544195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d0667a4e-9dc2-4bdd-b952-bbccde173ca6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:26.545004 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d0667a4e-9dc2-4bdd-b952-bbccde173ca6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:26.546925 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d0667a4e-9dc2-4bdd-b952-bbccde173ca6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:26.547536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d0667a4e-9dc2-4bdd-b952-bbccde173ca6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:26.692401 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4b321c3c-112e-4ba1-a703-b9f05ab124a1 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:26.695661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4b321c3c-112e-4ba1-a703-b9f05ab124a1 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:26.706528 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4b321c3c-112e-4ba1-a703-b9f05ab124a1 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:26.707312 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4b321c3c-112e-4ba1-a703-b9f05ab124a1 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:26.708319 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4b321c3c-112e-4ba1-a703-b9f05ab124a1 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:26.709590 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4b321c3c-112e-4ba1-a703-b9f05ab124a1 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:26.812989 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d0667a4e-9dc2-4bdd-b952-bbccde173ca6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:26.822221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d0667a4e-9dc2-4bdd-b952-bbccde173ca6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:26.824353 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d0667a4e-9dc2-4bdd-b952-bbccde173ca6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:26.825842 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d0667a4e-9dc2-4bdd-b952-bbccde173ca6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.294450 Jul 21 06:33:26.826999 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 253/503] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:26 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:26.832390 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-81c98247-6706-4e7d-9972-73bfbf35ff6b req-47942040-6c4b-4ef0-bef2-615b3fb05bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c3a3de3-c6af-4f50-b999-d47265b43595", "name": "network-vif-plugged", "status": "completed", "tag": "ec590c24-0627-4416-8dda-da4d559e2b05"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:26.842502 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-81c98247-6706-4e7d-9972-73bfbf35ff6b req-47942040-6c4b-4ef0-bef2-615b3fb05bba service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:26.843155 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-81c98247-6706-4e7d-9972-73bfbf35ff6b req-47942040-6c4b-4ef0-bef2-615b3fb05bba service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:26.858873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-81c98247-6706-4e7d-9972-73bfbf35ff6b req-47942040-6c4b-4ef0-bef2-615b3fb05bba service nova] Creating event network-vif-plugged:ec590c24-0627-4416-8dda-da4d559e2b05 for instance 3c3a3de3-c6af-4f50-b999-d47265b43595 on hv-cinder-85031 Jul 21 06:33:26.874351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-81c98247-6706-4e7d-9972-73bfbf35ff6b req-47942040-6c4b-4ef0-bef2-615b3fb05bba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045756 Jul 21 06:33:26.874989 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 254/504] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:26.969221 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4b321c3c-112e-4ba1-a703-b9f05ab124a1 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:26.983591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4b321c3c-112e-4ba1-a703-b9f05ab124a1 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1465 microversion: 2.1 time: 0.295833 Jul 21 06:33:26.986096 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 251/505] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:26 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1465 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:27.038785 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d02f0ffd-5682-4fb0-b80a-b1d1b04ecdd0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:27.039387 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d02f0ffd-5682-4fb0-b80a-b1d1b04ecdd0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:27.057874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d02f0ffd-5682-4fb0-b80a-b1d1b04ecdd0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:27.061978 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d02f0ffd-5682-4fb0-b80a-b1d1b04ecdd0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:27.065413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d02f0ffd-5682-4fb0-b80a-b1d1b04ecdd0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:27.068984 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d02f0ffd-5682-4fb0-b80a-b1d1b04ecdd0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:27.108618 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:27.117343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d02f0ffd-5682-4fb0-b80a-b1d1b04ecdd0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:33:27.180659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1b19e18d-59a0-4938-8f7e-53b22fda4d54 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:27.181285 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1b19e18d-59a0-4938-8f7e-53b22fda4d54 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:27.192322 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1b19e18d-59a0-4938-8f7e-53b22fda4d54 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:27.192772 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1b19e18d-59a0-4938-8f7e-53b22fda4d54 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:27.193566 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1b19e18d-59a0-4938-8f7e-53b22fda4d54 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:27.194030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1b19e18d-59a0-4938-8f7e-53b22fda4d54 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:27.216354 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:27.270151 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d02f0ffd-5682-4fb0-b80a-b1d1b04ecdd0 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 204 len: 0 microversion: 2.1 time: 0.235856 Jul 21 06:33:27.271338 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 255/506] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:33:27 2022] DELETE /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:33:27.282723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-58844dde-4308-4a17-81d8-3ac267ea0dce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:27.283675 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-58844dde-4308-4a17-81d8-3ac267ea0dce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:27.298436 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-58844dde-4308-4a17-81d8-3ac267ea0dce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:27.299258 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-58844dde-4308-4a17-81d8-3ac267ea0dce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:27.300837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-58844dde-4308-4a17-81d8-3ac267ea0dce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:27.301464 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-58844dde-4308-4a17-81d8-3ac267ea0dce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:27.771175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1b19e18d-59a0-4938-8f7e-53b22fda4d54 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:27.779179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-58844dde-4308-4a17-81d8-3ac267ea0dce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:27.788512 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-58844dde-4308-4a17-81d8-3ac267ea0dce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1708 microversion: 2.1 time: 0.515785 Jul 21 06:33:27.789172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1b19e18d-59a0-4938-8f7e-53b22fda4d54 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.612719 Jul 21 06:33:27.798238 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 256/507] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:27 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1708 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:27.814314 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 252/508] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:27 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:27.824739 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b29382e5-f556-450f-8518-763240a9293b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:27.825608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b29382e5-f556-450f-8518-763240a9293b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:27.832687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b29382e5-f556-450f-8518-763240a9293b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:27.833412 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b29382e5-f556-450f-8518-763240a9293b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:27.837226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b29382e5-f556-450f-8518-763240a9293b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:27.837683 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b29382e5-f556-450f-8518-763240a9293b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:27.853264 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0e9febe5-5721-4669-9824-3b7feaea7e98 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:27.853910 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0e9febe5-5721-4669-9824-3b7feaea7e98 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:27.865599 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e9febe5-5721-4669-9824-3b7feaea7e98 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:27.866079 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e9febe5-5721-4669-9824-3b7feaea7e98 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:27.866871 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e9febe5-5721-4669-9824-3b7feaea7e98 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:27.867311 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0e9febe5-5721-4669-9824-3b7feaea7e98 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:28.209734 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0e9febe5-5721-4669-9824-3b7feaea7e98 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:28.223672 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0e9febe5-5721-4669-9824-3b7feaea7e98 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:28.225197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0e9febe5-5721-4669-9824-3b7feaea7e98 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:28.226433 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0e9febe5-5721-4669-9824-3b7feaea7e98 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.384485 Jul 21 06:33:28.227002 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 253/509] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:27 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:28.250004 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b29382e5-f556-450f-8518-763240a9293b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:28.258762 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b29382e5-f556-450f-8518-763240a9293b tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.458365 Jul 21 06:33:28.269856 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 257/510] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:27 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:28.521071 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-fa263381-1b04-4fca-93d3-618f099b29fd req-432edd87-46f5-410c-ac69-698820984176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd12a96-a6ba-4881-9e69-20771a9b2d91", "tag": "30a8386c-e7fc-4d12-86c3-922716884c6e"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:28.545982 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-fa263381-1b04-4fca-93d3-618f099b29fd req-432edd87-46f5-410c-ac69-698820984176 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:28.551539 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-fa263381-1b04-4fca-93d3-618f099b29fd req-432edd87-46f5-410c-ac69-698820984176 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:28.582492 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-fa263381-1b04-4fca-93d3-618f099b29fd req-432edd87-46f5-410c-ac69-698820984176 service nova] Creating event network-changed:30a8386c-e7fc-4d12-86c3-922716884c6e for instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 on hv-cinder-85031 Jul 21 06:33:28.591610 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-fa263381-1b04-4fca-93d3-618f099b29fd req-432edd87-46f5-410c-ac69-698820984176 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074831 Jul 21 06:33:28.592936 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 254/511] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:28.810052 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-830dc2c3-904c-4356-8dbd-c7e62ec2223b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:28.810704 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-830dc2c3-904c-4356-8dbd-c7e62ec2223b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:28.820869 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6769fd11-6405-4d3c-a4d3-ea44d61ee09d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:28.822733 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6769fd11-6405-4d3c-a4d3-ea44d61ee09d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:28.839798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6769fd11-6405-4d3c-a4d3-ea44d61ee09d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:28.843788 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-830dc2c3-904c-4356-8dbd-c7e62ec2223b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:28.851742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-830dc2c3-904c-4356-8dbd-c7e62ec2223b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:28.854284 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6769fd11-6405-4d3c-a4d3-ea44d61ee09d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:28.865172 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-830dc2c3-904c-4356-8dbd-c7e62ec2223b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:28.866034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-830dc2c3-904c-4356-8dbd-c7e62ec2223b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:28.867267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6769fd11-6405-4d3c-a4d3-ea44d61ee09d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:28.872570 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6769fd11-6405-4d3c-a4d3-ea44d61ee09d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:29.145341 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-830dc2c3-904c-4356-8dbd-c7e62ec2223b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:29.165975 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-830dc2c3-904c-4356-8dbd-c7e62ec2223b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1712 microversion: 2.1 time: 0.360843 Jul 21 06:33:29.174094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 258/512] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:28 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1712 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:29.184306 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6769fd11-6405-4d3c-a4d3-ea44d61ee09d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:29.195628 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6769fd11-6405-4d3c-a4d3-ea44d61ee09d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.379895 Jul 21 06:33:29.196928 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 255/513] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:28 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:29.245114 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c322e7a3-a6f9-4c85-b2b5-80f0cfbb3a08 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:29.245868 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c322e7a3-a6f9-4c85-b2b5-80f0cfbb3a08 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:29.257270 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c322e7a3-a6f9-4c85-b2b5-80f0cfbb3a08 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:29.258110 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c322e7a3-a6f9-4c85-b2b5-80f0cfbb3a08 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:29.259219 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c322e7a3-a6f9-4c85-b2b5-80f0cfbb3a08 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:29.259892 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c322e7a3-a6f9-4c85-b2b5-80f0cfbb3a08 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:29.276779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fcf1ce91-0b73-4e32-9ef8-af097cda9133 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:29.277397 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fcf1ce91-0b73-4e32-9ef8-af097cda9133 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:29.285093 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fcf1ce91-0b73-4e32-9ef8-af097cda9133 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:29.285828 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fcf1ce91-0b73-4e32-9ef8-af097cda9133 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:29.286877 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fcf1ce91-0b73-4e32-9ef8-af097cda9133 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:29.287480 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fcf1ce91-0b73-4e32-9ef8-af097cda9133 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:29.528401 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c322e7a3-a6f9-4c85-b2b5-80f0cfbb3a08 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:29.544779 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c322e7a3-a6f9-4c85-b2b5-80f0cfbb3a08 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:29.546618 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c322e7a3-a6f9-4c85-b2b5-80f0cfbb3a08 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:29.548003 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c322e7a3-a6f9-4c85-b2b5-80f0cfbb3a08 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.307183 Jul 21 06:33:29.554249 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 259/514] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:29 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:29.578300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fcf1ce91-0b73-4e32-9ef8-af097cda9133 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:29.587215 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fcf1ce91-0b73-4e32-9ef8-af097cda9133 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.314424 Jul 21 06:33:29.588126 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 256/515] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:29 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:30.224934 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6286e846-2fc4-4bcc-9d34-8b54379eeaab tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:30.225634 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6286e846-2fc4-4bcc-9d34-8b54379eeaab tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:30.233167 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6286e846-2fc4-4bcc-9d34-8b54379eeaab tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:30.233635 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6286e846-2fc4-4bcc-9d34-8b54379eeaab tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:30.234501 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6286e846-2fc4-4bcc-9d34-8b54379eeaab tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:30.234914 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6286e846-2fc4-4bcc-9d34-8b54379eeaab tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:30.410957 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6286e846-2fc4-4bcc-9d34-8b54379eeaab tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:30.418634 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6286e846-2fc4-4bcc-9d34-8b54379eeaab tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.207969 Jul 21 06:33:30.428343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 260/516] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:30 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:30.573194 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3763a293-062e-47fe-892d-6f9cb82cf4ab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:30.573975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3763a293-062e-47fe-892d-6f9cb82cf4ab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:30.581246 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3763a293-062e-47fe-892d-6f9cb82cf4ab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:30.582902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3763a293-062e-47fe-892d-6f9cb82cf4ab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:30.584016 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3763a293-062e-47fe-892d-6f9cb82cf4ab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:30.584990 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3763a293-062e-47fe-892d-6f9cb82cf4ab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:30.605069 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-eb5e059d-ade7-41aa-b6a1-40eee3e2a179 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:30.605887 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-eb5e059d-ade7-41aa-b6a1-40eee3e2a179 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:30.617825 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-eb5e059d-ade7-41aa-b6a1-40eee3e2a179 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:30.618324 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-eb5e059d-ade7-41aa-b6a1-40eee3e2a179 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:30.619107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-eb5e059d-ade7-41aa-b6a1-40eee3e2a179 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:30.619540 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-eb5e059d-ade7-41aa-b6a1-40eee3e2a179 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:30.828817 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3763a293-062e-47fe-892d-6f9cb82cf4ab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:30.842777 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3763a293-062e-47fe-892d-6f9cb82cf4ab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:30.844973 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3763a293-062e-47fe-892d-6f9cb82cf4ab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:30.849655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3763a293-062e-47fe-892d-6f9cb82cf4ab tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.280421 Jul 21 06:33:30.853855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 257/517] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:30 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:30.876987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-eb5e059d-ade7-41aa-b6a1-40eee3e2a179 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:30.886899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-eb5e059d-ade7-41aa-b6a1-40eee3e2a179 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.285588 Jul 21 06:33:30.887832 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 261/518] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:30 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:31.437297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8c8afd3f-19c4-4aff-8d1b-e4c7d89ed62d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:31.438044 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8c8afd3f-19c4-4aff-8d1b-e4c7d89ed62d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:31.446356 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8c8afd3f-19c4-4aff-8d1b-e4c7d89ed62d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:31.446979 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8c8afd3f-19c4-4aff-8d1b-e4c7d89ed62d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:31.447998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8c8afd3f-19c4-4aff-8d1b-e4c7d89ed62d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:31.448585 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8c8afd3f-19c4-4aff-8d1b-e4c7d89ed62d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:31.668300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8c8afd3f-19c4-4aff-8d1b-e4c7d89ed62d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:31.676097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8c8afd3f-19c4-4aff-8d1b-e4c7d89ed62d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.243952 Jul 21 06:33:31.676681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 258/519] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:31 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:31.868906 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-fcad2c9c-c080-43d1-9da6-81fc42094b0a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:31.869618 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-fcad2c9c-c080-43d1-9da6-81fc42094b0a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:31.876208 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fcad2c9c-c080-43d1-9da6-81fc42094b0a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:31.876729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fcad2c9c-c080-43d1-9da6-81fc42094b0a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:31.877669 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fcad2c9c-c080-43d1-9da6-81fc42094b0a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:31.878287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fcad2c9c-c080-43d1-9da6-81fc42094b0a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:31.907616 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b68d76a2-28f9-4e77-9b0b-bd7e3e70dcc9 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:31.908495 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b68d76a2-28f9-4e77-9b0b-bd7e3e70dcc9 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:31.932055 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b68d76a2-28f9-4e77-9b0b-bd7e3e70dcc9 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:31.933145 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b68d76a2-28f9-4e77-9b0b-bd7e3e70dcc9 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:31.934063 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b68d76a2-28f9-4e77-9b0b-bd7e3e70dcc9 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:31.939408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b68d76a2-28f9-4e77-9b0b-bd7e3e70dcc9 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:32.102201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fcad2c9c-c080-43d1-9da6-81fc42094b0a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:32.111233 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fcad2c9c-c080-43d1-9da6-81fc42094b0a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:32.117465 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fcad2c9c-c080-43d1-9da6-81fc42094b0a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:32.118714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-fcad2c9c-c080-43d1-9da6-81fc42094b0a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.253711 Jul 21 06:33:32.126728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 262/520] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:31 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:32.237809 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b68d76a2-28f9-4e77-9b0b-bd7e3e70dcc9 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:32.255975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b68d76a2-28f9-4e77-9b0b-bd7e3e70dcc9 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.352775 Jul 21 06:33:32.256866 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 259/521] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:31 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:32.693787 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f7ee8c0c-8b60-484b-8b4a-f5f20535c86a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:32.694525 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f7ee8c0c-8b60-484b-8b4a-f5f20535c86a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:32.705572 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7ee8c0c-8b60-484b-8b4a-f5f20535c86a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:32.706087 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7ee8c0c-8b60-484b-8b4a-f5f20535c86a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:32.709972 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7ee8c0c-8b60-484b-8b4a-f5f20535c86a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:32.710434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7ee8c0c-8b60-484b-8b4a-f5f20535c86a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:32.868621 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f7ee8c0c-8b60-484b-8b4a-f5f20535c86a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:32.877321 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f7ee8c0c-8b60-484b-8b4a-f5f20535c86a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.188311 Jul 21 06:33:32.882854 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 263/522] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:32 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:33.146764 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-03a083c7-fe1e-405e-9cb0-e7d911cde0e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:33.147374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-03a083c7-fe1e-405e-9cb0-e7d911cde0e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:33.154834 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-03a083c7-fe1e-405e-9cb0-e7d911cde0e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:33.155292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-03a083c7-fe1e-405e-9cb0-e7d911cde0e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:33.156071 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-03a083c7-fe1e-405e-9cb0-e7d911cde0e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:33.156509 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-03a083c7-fe1e-405e-9cb0-e7d911cde0e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:33.273571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-fe3b2f03-f27d-4be7-8013-b7226d0f580f tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:33.274247 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-fe3b2f03-f27d-4be7-8013-b7226d0f580f tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:33.280514 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fe3b2f03-f27d-4be7-8013-b7226d0f580f tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:33.280974 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fe3b2f03-f27d-4be7-8013-b7226d0f580f tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:33.281749 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fe3b2f03-f27d-4be7-8013-b7226d0f580f tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:33.282224 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fe3b2f03-f27d-4be7-8013-b7226d0f580f tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:33.309632 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-03a083c7-fe1e-405e-9cb0-e7d911cde0e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:33.325840 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-03a083c7-fe1e-405e-9cb0-e7d911cde0e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:33.327861 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-03a083c7-fe1e-405e-9cb0-e7d911cde0e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:33.331148 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-03a083c7-fe1e-405e-9cb0-e7d911cde0e0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.190028 Jul 21 06:33:33.335256 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 260/523] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:33 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:33.435768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fe3b2f03-f27d-4be7-8013-b7226d0f580f tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:33.444891 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-fe3b2f03-f27d-4be7-8013-b7226d0f580f tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.175549 Jul 21 06:33:33.445744 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 264/524] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:33 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:33.812320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1677276418", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "networks": [{"uuid": "2bc81270-f5d2-4da2-b2e3-48a4f6d8f429"}]}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:33.864681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.network.neutron [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] validate_networks() for [('2bc81270-f5d2-4da2-b2e3-48a4f6d8f429', None, None, None, None, None)] {{(pid=117905) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:33:33.895729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8c7398d1-4f92-4b1b-a467-9c40c2a900d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:33.896520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8c7398d1-4f92-4b1b-a467-9c40c2a900d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:33.903522 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c7398d1-4f92-4b1b-a467-9c40c2a900d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:33.904099 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c7398d1-4f92-4b1b-a467-9c40c2a900d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:33.905456 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c7398d1-4f92-4b1b-a467-9c40c2a900d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:33.906158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8c7398d1-4f92-4b1b-a467-9c40c2a900d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:34.110495 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8c7398d1-4f92-4b1b-a467-9c40c2a900d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:34.118631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8c7398d1-4f92-4b1b-a467-9c40c2a900d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.227483 Jul 21 06:33:34.119288 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 265/525] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:33 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:34.346604 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Flavor limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:33:34.347761 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Image limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:33:34.348212 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Flavor pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:33:34.348626 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Image pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:33:34.349042 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:33:34.352949 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-adad788f-359b-4c86-808c-4225f55f97d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:34.353556 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-adad788f-359b-4c86-808c-4225f55f97d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:34.357821 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:34.358312 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:34.359109 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:34.359546 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:34.359654 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-adad788f-359b-4c86-808c-4225f55f97d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:34.360026 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-adad788f-359b-4c86-808c-4225f55f97d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:34.360780 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-adad788f-359b-4c86-808c-4225f55f97d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:34.361214 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-adad788f-359b-4c86-808c-4225f55f97d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:34.378919 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Getting quotas for project 854daeeee974410c9a0afafee795e72c. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:33:34.383291 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Getting quotas for user efafaa14b3e146eba88412c382a8b977 and project 854daeeee974410c9a0afafee795e72c. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:33:34.414051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Going to run 1 instances... {{(pid=117905) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:33:34.416614 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:33:34.461602 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fb7fc0c4-7b5d-474c-a3cd-eedcddd0fcc3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653286 Jul 21 06:33:34.462299 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 261/526] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:33:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:33:34.470769 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-abea9278-02fc-4e56-afc7-22bc172b2599 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:34.471496 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-abea9278-02fc-4e56-afc7-22bc172b2599 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:34.474685 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:34.480886 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-abea9278-02fc-4e56-afc7-22bc172b2599 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:34.481446 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-abea9278-02fc-4e56-afc7-22bc172b2599 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:34.482318 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-abea9278-02fc-4e56-afc7-22bc172b2599 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:34.482754 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-abea9278-02fc-4e56-afc7-22bc172b2599 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:34.533661 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-adad788f-359b-4c86-808c-4225f55f97d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:34.547170 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-adad788f-359b-4c86-808c-4225f55f97d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:34.549785 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-adad788f-359b-4c86-808c-4225f55f97d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:34.551497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-adad788f-359b-4c86-808c-4225f55f97d4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.202384 Jul 21 06:33:34.552322 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 266/527] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:34 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:34.557183 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8effa859-a3d0-48f7-9606-e015867df111 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:34.558033 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8effa859-a3d0-48f7-9606-e015867df111 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:34.633671 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8effa859-a3d0-48f7-9606-e015867df111 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:34.645451 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8effa859-a3d0-48f7-9606-e015867df111 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1219 microversion: 2.1 time: 0.091832 Jul 21 06:33:34.646640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 267/528] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:34 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:34.702896 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-abea9278-02fc-4e56-afc7-22bc172b2599 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:34.711350 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-abea9278-02fc-4e56-afc7-22bc172b2599 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.248075 Jul 21 06:33:34.713632 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 262/529] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:34 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:35.137014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c22f6540-08d3-4751-8376-5e9baaa8649a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:35.139200 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c22f6540-08d3-4751-8376-5e9baaa8649a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:35.147163 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c22f6540-08d3-4751-8376-5e9baaa8649a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:35.148148 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c22f6540-08d3-4751-8376-5e9baaa8649a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:35.149404 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c22f6540-08d3-4751-8376-5e9baaa8649a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:35.150288 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c22f6540-08d3-4751-8376-5e9baaa8649a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:35.288200 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c22f6540-08d3-4751-8376-5e9baaa8649a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:35.296402 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c22f6540-08d3-4751-8376-5e9baaa8649a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.163652 Jul 21 06:33:35.296986 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 268/530] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:35 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:35.575197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-18df60a5-ea13-4967-9d04-a1f90bdd64a8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:35.576582 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-18df60a5-ea13-4967-9d04-a1f90bdd64a8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:35.583637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-18df60a5-ea13-4967-9d04-a1f90bdd64a8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:35.584091 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-18df60a5-ea13-4967-9d04-a1f90bdd64a8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:35.584878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-18df60a5-ea13-4967-9d04-a1f90bdd64a8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:35.585321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-18df60a5-ea13-4967-9d04-a1f90bdd64a8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:35.663460 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e9939f10-3afa-45a4-ac4f-6155f6d55c5e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:35.664327 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e9939f10-3afa-45a4-ac4f-6155f6d55c5e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:35.678301 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9939f10-3afa-45a4-ac4f-6155f6d55c5e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:35.678843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9939f10-3afa-45a4-ac4f-6155f6d55c5e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:35.679795 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9939f10-3afa-45a4-ac4f-6155f6d55c5e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:35.680327 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e9939f10-3afa-45a4-ac4f-6155f6d55c5e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:35.753181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e9939f10-3afa-45a4-ac4f-6155f6d55c5e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:35.756899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-18df60a5-ea13-4967-9d04-a1f90bdd64a8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:35.761296 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e9939f10-3afa-45a4-ac4f-6155f6d55c5e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1223 microversion: 2.1 time: 0.101775 Jul 21 06:33:35.761871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 269/531] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:35 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:35.766278 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-033289f9-8555-4422-b847-fa28fc91bdc5 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:35.766555 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-18df60a5-ea13-4967-9d04-a1f90bdd64a8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:35.766884 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-033289f9-8555-4422-b847-fa28fc91bdc5 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:35.768434 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-18df60a5-ea13-4967-9d04-a1f90bdd64a8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:35.770992 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-18df60a5-ea13-4967-9d04-a1f90bdd64a8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.201516 Jul 21 06:33:35.772568 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 263/532] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:35 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:35.773695 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-033289f9-8555-4422-b847-fa28fc91bdc5 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:35.774183 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-033289f9-8555-4422-b847-fa28fc91bdc5 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:35.774955 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-033289f9-8555-4422-b847-fa28fc91bdc5 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:35.775387 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-033289f9-8555-4422-b847-fa28fc91bdc5 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:35.915883 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-033289f9-8555-4422-b847-fa28fc91bdc5 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:35.923710 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-033289f9-8555-4422-b847-fa28fc91bdc5 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.160749 Jul 21 06:33:35.924331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 270/533] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:35 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:36.312619 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8b3e7c46-7769-4bc2-ac04-daae8a2a7ddd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:36.313226 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8b3e7c46-7769-4bc2-ac04-daae8a2a7ddd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:36.319696 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8b3e7c46-7769-4bc2-ac04-daae8a2a7ddd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:36.320151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8b3e7c46-7769-4bc2-ac04-daae8a2a7ddd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:36.320942 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8b3e7c46-7769-4bc2-ac04-daae8a2a7ddd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:36.321380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8b3e7c46-7769-4bc2-ac04-daae8a2a7ddd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:36.453637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8b3e7c46-7769-4bc2-ac04-daae8a2a7ddd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:36.462843 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8b3e7c46-7769-4bc2-ac04-daae8a2a7ddd tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.154033 Jul 21 06:33:36.463548 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 264/534] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:36 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:36.779626 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-61fdb1d0-2bfd-4957-a7f4-8f5bc6be9545 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:36.780289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-61fdb1d0-2bfd-4957-a7f4-8f5bc6be9545 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:36.786933 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-61fdb1d0-2bfd-4957-a7f4-8f5bc6be9545 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:36.787460 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-61fdb1d0-2bfd-4957-a7f4-8f5bc6be9545 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:36.788279 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-61fdb1d0-2bfd-4957-a7f4-8f5bc6be9545 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:36.788714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-61fdb1d0-2bfd-4957-a7f4-8f5bc6be9545 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:36.790612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-662101e6-65fa-456b-9ba7-1f2c55e8dfeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:36.791303 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-662101e6-65fa-456b-9ba7-1f2c55e8dfeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:36.798474 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-662101e6-65fa-456b-9ba7-1f2c55e8dfeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:36.799009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-662101e6-65fa-456b-9ba7-1f2c55e8dfeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:36.799872 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-662101e6-65fa-456b-9ba7-1f2c55e8dfeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:36.800411 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-662101e6-65fa-456b-9ba7-1f2c55e8dfeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:36.810874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:36.863061 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-61fdb1d0-2bfd-4957-a7f4-8f5bc6be9545 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:36.870682 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-61fdb1d0-2bfd-4957-a7f4-8f5bc6be9545 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1223 microversion: 2.1 time: 0.095299 Jul 21 06:33:36.871695 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 271/535] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:36 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:36.941381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-60e815ba-b1ce-44c9-97f6-e592850726ea tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:36.942219 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-60e815ba-b1ce-44c9-97f6-e592850726ea tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:36.948741 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-60e815ba-b1ce-44c9-97f6-e592850726ea tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:36.949197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-60e815ba-b1ce-44c9-97f6-e592850726ea tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:36.950006 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-60e815ba-b1ce-44c9-97f6-e592850726ea tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:36.950448 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-60e815ba-b1ce-44c9-97f6-e592850726ea tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:37.230763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-662101e6-65fa-456b-9ba7-1f2c55e8dfeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:37.242036 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-662101e6-65fa-456b-9ba7-1f2c55e8dfeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:37.243854 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-662101e6-65fa-456b-9ba7-1f2c55e8dfeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:37.245030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-662101e6-65fa-456b-9ba7-1f2c55e8dfeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.458364 Jul 21 06:33:37.245601 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 265/536] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:36 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:37.257123 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-60e815ba-b1ce-44c9-97f6-e592850726ea tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:37.264625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-60e815ba-b1ce-44c9-97f6-e592850726ea tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.327850 Jul 21 06:33:37.265184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 272/537] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:36 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:37.479720 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5f4e0ea2-29df-4672-8822-0b809ff6cc09 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:37.480344 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5f4e0ea2-29df-4672-8822-0b809ff6cc09 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:37.486409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f4e0ea2-29df-4672-8822-0b809ff6cc09 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:37.486859 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f4e0ea2-29df-4672-8822-0b809ff6cc09 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:37.488711 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f4e0ea2-29df-4672-8822-0b809ff6cc09 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:37.489150 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f4e0ea2-29df-4672-8822-0b809ff6cc09 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:37.617612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5f4e0ea2-29df-4672-8822-0b809ff6cc09 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:37.624871 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5f4e0ea2-29df-4672-8822-0b809ff6cc09 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.148981 Jul 21 06:33:37.625442 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 266/538] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:37 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:37.889431 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0564c930-d129-4024-8042-de90b07b974e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:37.890054 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0564c930-d129-4024-8042-de90b07b974e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:37.897269 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0564c930-d129-4024-8042-de90b07b974e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:37.897995 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0564c930-d129-4024-8042-de90b07b974e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:37.898760 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0564c930-d129-4024-8042-de90b07b974e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:37.899197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0564c930-d129-4024-8042-de90b07b974e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:37.958863 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0564c930-d129-4024-8042-de90b07b974e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:37.966209 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0564c930-d129-4024-8042-de90b07b974e tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1223 microversion: 2.1 time: 0.081687 Jul 21 06:33:37.966776 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 273/539] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:37 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:38.263590 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8f4e7021-4adc-4faf-8c5c-45f30c080ae2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:38.264194 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8f4e7021-4adc-4faf-8c5c-45f30c080ae2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:38.270704 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8f4e7021-4adc-4faf-8c5c-45f30c080ae2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:38.271151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8f4e7021-4adc-4faf-8c5c-45f30c080ae2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:38.271905 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8f4e7021-4adc-4faf-8c5c-45f30c080ae2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:38.272339 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8f4e7021-4adc-4faf-8c5c-45f30c080ae2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:38.282619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c4d3f66d-f210-4435-8844-84d0835b698a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:38.285079 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c4d3f66d-f210-4435-8844-84d0835b698a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:38.291200 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c4d3f66d-f210-4435-8844-84d0835b698a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:38.291662 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c4d3f66d-f210-4435-8844-84d0835b698a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:38.292434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c4d3f66d-f210-4435-8844-84d0835b698a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:38.292872 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c4d3f66d-f210-4435-8844-84d0835b698a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:38.474444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8f4e7021-4adc-4faf-8c5c-45f30c080ae2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:38.477788 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c4d3f66d-f210-4435-8844-84d0835b698a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:38.482995 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8f4e7021-4adc-4faf-8c5c-45f30c080ae2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:38.484648 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8f4e7021-4adc-4faf-8c5c-45f30c080ae2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:38.485575 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c4d3f66d-f210-4435-8844-84d0835b698a tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.206976 Jul 21 06:33:38.485818 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8f4e7021-4adc-4faf-8c5c-45f30c080ae2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.226126 Jul 21 06:33:38.486202 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 274/540] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:38 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:38.487009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 267/541] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:38 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:38.640451 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9b91702e-285a-48ac-ab25-0aeb5e46bec1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:38.641011 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9b91702e-285a-48ac-ab25-0aeb5e46bec1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:38.648171 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b91702e-285a-48ac-ab25-0aeb5e46bec1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:38.648620 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b91702e-285a-48ac-ab25-0aeb5e46bec1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:38.649509 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b91702e-285a-48ac-ab25-0aeb5e46bec1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:38.650064 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b91702e-285a-48ac-ab25-0aeb5e46bec1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:38.781650 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9b91702e-285a-48ac-ab25-0aeb5e46bec1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:38.789964 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9b91702e-285a-48ac-ab25-0aeb5e46bec1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.153318 Jul 21 06:33:38.790544 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 275/542] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:38 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:38.983742 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-965d238e-1c84-46b0-9b94-273f136e235f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:38.984340 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-965d238e-1c84-46b0-9b94-273f136e235f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:38.990402 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-965d238e-1c84-46b0-9b94-273f136e235f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:38.990849 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-965d238e-1c84-46b0-9b94-273f136e235f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:38.991601 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-965d238e-1c84-46b0-9b94-273f136e235f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:38.992037 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-965d238e-1c84-46b0-9b94-273f136e235f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:39.057062 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-965d238e-1c84-46b0-9b94-273f136e235f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:39.064492 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-965d238e-1c84-46b0-9b94-273f136e235f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1223 microversion: 2.1 time: 0.084683 Jul 21 06:33:39.065057 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 268/543] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:38 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:39.503929 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-18f1522d-ce92-4665-bfb9-651ee1df6b18 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:39.504543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-18f1522d-ce92-4665-bfb9-651ee1df6b18 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:39.504753 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e21a3183-4049-4604-a302-3edfd9b90fd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:39.505524 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e21a3183-4049-4604-a302-3edfd9b90fd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:39.511293 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18f1522d-ce92-4665-bfb9-651ee1df6b18 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:39.511666 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18f1522d-ce92-4665-bfb9-651ee1df6b18 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:39.512009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e21a3183-4049-4604-a302-3edfd9b90fd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:39.512439 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18f1522d-ce92-4665-bfb9-651ee1df6b18 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:39.512539 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e21a3183-4049-4604-a302-3edfd9b90fd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:39.512881 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18f1522d-ce92-4665-bfb9-651ee1df6b18 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:39.513211 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e21a3183-4049-4604-a302-3edfd9b90fd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:39.513651 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e21a3183-4049-4604-a302-3edfd9b90fd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:39.698413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-18f1522d-ce92-4665-bfb9-651ee1df6b18 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:39.705374 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-18f1522d-ce92-4665-bfb9-651ee1df6b18 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.205819 Jul 21 06:33:39.705966 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 276/544] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:39 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:39.712471 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e21a3183-4049-4604-a302-3edfd9b90fd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:39.721043 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e21a3183-4049-4604-a302-3edfd9b90fd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:39.723374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e21a3183-4049-4604-a302-3edfd9b90fd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:39.724575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e21a3183-4049-4604-a302-3edfd9b90fd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.224015 Jul 21 06:33:39.725134 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 269/545] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:39 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:39.807001 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bc24291c-ca76-4653-b108-bab55002714c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:39.807537 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bc24291c-ca76-4653-b108-bab55002714c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:39.813450 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc24291c-ca76-4653-b108-bab55002714c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:39.813897 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc24291c-ca76-4653-b108-bab55002714c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:39.814703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc24291c-ca76-4653-b108-bab55002714c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:39.815142 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc24291c-ca76-4653-b108-bab55002714c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:39.945628 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bc24291c-ca76-4653-b108-bab55002714c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:39.953089 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bc24291c-ca76-4653-b108-bab55002714c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.149888 Jul 21 06:33:39.953662 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 277/546] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:39 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:40.081893 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7ab03ace-f607-48aa-a3ab-93bd2fa295d3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:40.082539 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7ab03ace-f607-48aa-a3ab-93bd2fa295d3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:40.088518 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7ab03ace-f607-48aa-a3ab-93bd2fa295d3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:40.088966 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7ab03ace-f607-48aa-a3ab-93bd2fa295d3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:40.089720 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7ab03ace-f607-48aa-a3ab-93bd2fa295d3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:40.090190 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7ab03ace-f607-48aa-a3ab-93bd2fa295d3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:40.094065 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:40.154787 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7ab03ace-f607-48aa-a3ab-93bd2fa295d3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:40.162537 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7ab03ace-f607-48aa-a3ab-93bd2fa295d3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1215 microversion: 2.1 time: 0.084978 Jul 21 06:33:40.163101 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 270/547] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:40 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:40.724295 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-18882d3e-f256-491c-ac4d-119ce698bf49 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:40.724914 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-18882d3e-f256-491c-ac4d-119ce698bf49 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:40.731494 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18882d3e-f256-491c-ac4d-119ce698bf49 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:40.731944 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18882d3e-f256-491c-ac4d-119ce698bf49 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:40.732715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18882d3e-f256-491c-ac4d-119ce698bf49 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:40.733137 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18882d3e-f256-491c-ac4d-119ce698bf49 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:40.743418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fac6bd54-19cd-4487-b11f-c854a8591d51 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:40.744045 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fac6bd54-19cd-4487-b11f-c854a8591d51 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:40.750500 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fac6bd54-19cd-4487-b11f-c854a8591d51 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:40.750955 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fac6bd54-19cd-4487-b11f-c854a8591d51 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:40.751713 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fac6bd54-19cd-4487-b11f-c854a8591d51 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:40.752327 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fac6bd54-19cd-4487-b11f-c854a8591d51 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:40.935928 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-18882d3e-f256-491c-ac4d-119ce698bf49 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:40.972199 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fac6bd54-19cd-4487-b11f-c854a8591d51 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:40.983554 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-18882d3e-f256-491c-ac4d-119ce698bf49 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1471 microversion: 2.1 time: 0.264286 Jul 21 06:33:40.985478 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 278/548] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:40 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:40.987505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fac6bd54-19cd-4487-b11f-c854a8591d51 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:40.989218 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fac6bd54-19cd-4487-b11f-c854a8591d51 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:40.990658 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fac6bd54-19cd-4487-b11f-c854a8591d51 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.251024 Jul 21 06:33:40.991792 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 271/549] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:40 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:40.992241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-64bfda05-b5d4-4f51-9aa8-352de1a11d6f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:40.993111 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-64bfda05-b5d4-4f51-9aa8-352de1a11d6f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:41.000434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-64bfda05-b5d4-4f51-9aa8-352de1a11d6f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:41.001346 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-64bfda05-b5d4-4f51-9aa8-352de1a11d6f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:41.002383 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-64bfda05-b5d4-4f51-9aa8-352de1a11d6f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:41.003079 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-64bfda05-b5d4-4f51-9aa8-352de1a11d6f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:41.181367 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d78c8740-9d42-46c9-8b20-12c0aa3b8bf2 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:41.182219 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d78c8740-9d42-46c9-8b20-12c0aa3b8bf2 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:41.188927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d78c8740-9d42-46c9-8b20-12c0aa3b8bf2 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:41.189387 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d78c8740-9d42-46c9-8b20-12c0aa3b8bf2 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:41.190332 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d78c8740-9d42-46c9-8b20-12c0aa3b8bf2 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:41.190858 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d78c8740-9d42-46c9-8b20-12c0aa3b8bf2 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:41.263730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-64bfda05-b5d4-4f51-9aa8-352de1a11d6f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:41.271132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-64bfda05-b5d4-4f51-9aa8-352de1a11d6f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1367 microversion: 2.1 time: 0.284178 Jul 21 06:33:41.271703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 279/550] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:40 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:41.292028 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d78c8740-9d42-46c9-8b20-12c0aa3b8bf2 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:41.299608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d78c8740-9d42-46c9-8b20-12c0aa3b8bf2 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1271 microversion: 2.1 time: 0.123054 Jul 21 06:33:41.306139 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 272/551] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:41 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:41.540317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-50dae800-c037-44a3-8a0e-26df51ca4be6 req-e151c7e3-59b6-4f65-ad4e-01bc979da0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24361d41-5ef8-4321-83a7-78a2343df7cf", "name": "network-vif-deleted", "tag": "f8ba934b-7de0-4f79-8aab-dce56ba52871"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:41.548570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-50dae800-c037-44a3-8a0e-26df51ca4be6 req-e151c7e3-59b6-4f65-ad4e-01bc979da0de service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:41.549014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-50dae800-c037-44a3-8a0e-26df51ca4be6 req-e151c7e3-59b6-4f65-ad4e-01bc979da0de service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:41.560280 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-50dae800-c037-44a3-8a0e-26df51ca4be6 req-e151c7e3-59b6-4f65-ad4e-01bc979da0de service nova] Creating event network-vif-deleted:f8ba934b-7de0-4f79-8aab-dce56ba52871 for instance 24361d41-5ef8-4321-83a7-78a2343df7cf on hv-cinder-85031 Jul 21 06:33:41.565625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-50dae800-c037-44a3-8a0e-26df51ca4be6 req-e151c7e3-59b6-4f65-ad4e-01bc979da0de service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028889 Jul 21 06:33:41.566364 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 280/552] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:42.002424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5fcd0e88-10e8-47f0-a6d4-170003b00514 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:42.002881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5fcd0e88-10e8-47f0-a6d4-170003b00514 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:42.013233 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dc6dbe69-80ff-4e25-8ebe-155a6f8bbf27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:42.014025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dc6dbe69-80ff-4e25-8ebe-155a6f8bbf27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:42.017470 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5fcd0e88-10e8-47f0-a6d4-170003b00514 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:42.018048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5fcd0e88-10e8-47f0-a6d4-170003b00514 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:42.019591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5fcd0e88-10e8-47f0-a6d4-170003b00514 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:42.020029 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5fcd0e88-10e8-47f0-a6d4-170003b00514 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:42.023367 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dc6dbe69-80ff-4e25-8ebe-155a6f8bbf27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:42.024087 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dc6dbe69-80ff-4e25-8ebe-155a6f8bbf27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:42.025033 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dc6dbe69-80ff-4e25-8ebe-155a6f8bbf27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:42.025473 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dc6dbe69-80ff-4e25-8ebe-155a6f8bbf27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:42.099341 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5fcd0e88-10e8-47f0-a6d4-170003b00514 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425f2b3ad664922961e848dfdd010d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38392ff9294ce08fb43f32f6176c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:42.114952 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5fcd0e88-10e8-47f0-a6d4-170003b00514 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 200 len: 1429 microversion: 2.1 time: 0.116815 Jul 21 06:33:42.124503 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 273/553] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:41 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:42.206279 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dc6dbe69-80ff-4e25-8ebe-155a6f8bbf27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:42.215570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dc6dbe69-80ff-4e25-8ebe-155a6f8bbf27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:42.217084 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dc6dbe69-80ff-4e25-8ebe-155a6f8bbf27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:42.218383 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dc6dbe69-80ff-4e25-8ebe-155a6f8bbf27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.210073 Jul 21 06:33:42.218958 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 281/554] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:42 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:42.289256 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-21d5dbd2-73e0-4874-839f-1b771f4cff9b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:42.289916 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-21d5dbd2-73e0-4874-839f-1b771f4cff9b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:42.296099 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-21d5dbd2-73e0-4874-839f-1b771f4cff9b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:42.296545 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-21d5dbd2-73e0-4874-839f-1b771f4cff9b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:42.297427 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-21d5dbd2-73e0-4874-839f-1b771f4cff9b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:42.298035 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-21d5dbd2-73e0-4874-839f-1b771f4cff9b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:42.317867 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-069a9e85-21f6-4c51-b0f6-11c3425d7788 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:42.318789 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-069a9e85-21f6-4c51-b0f6-11c3425d7788 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:42.325351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-069a9e85-21f6-4c51-b0f6-11c3425d7788 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:42.325903 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-069a9e85-21f6-4c51-b0f6-11c3425d7788 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:42.326813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-069a9e85-21f6-4c51-b0f6-11c3425d7788 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:42.327317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-069a9e85-21f6-4c51-b0f6-11c3425d7788 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:42.407244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-069a9e85-21f6-4c51-b0f6-11c3425d7788 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:42.420634 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-069a9e85-21f6-4c51-b0f6-11c3425d7788 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1271 microversion: 2.1 time: 0.107456 Jul 21 06:33:42.421223 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 282/555] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:42 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:42.470570 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-21d5dbd2-73e0-4874-839f-1b771f4cff9b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:42.480448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-21d5dbd2-73e0-4874-839f-1b771f4cff9b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1558 microversion: 2.1 time: 0.196394 Jul 21 06:33:42.481250 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 274/556] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:42 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:42.500980 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a1de3781-f99b-4fba-8a3d-71c325682530 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:42.501473 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a1de3781-f99b-4fba-8a3d-71c325682530 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:42.508232 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a1de3781-f99b-4fba-8a3d-71c325682530 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:42.508676 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a1de3781-f99b-4fba-8a3d-71c325682530 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:42.509435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a1de3781-f99b-4fba-8a3d-71c325682530 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:42.509906 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a1de3781-f99b-4fba-8a3d-71c325682530 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:42.589473 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a1de3781-f99b-4fba-8a3d-71c325682530 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093264 Jul 21 06:33:42.590112 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 283/557] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 06:33:42 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:43.132608 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fb72338c-bc8c-452f-8ff7-a70960cce2e3 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:43.133274 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fb72338c-bc8c-452f-8ff7-a70960cce2e3 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] [instance: 24361d41-5ef8-4321-83a7-78a2343df7cf] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:43.141467 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb72338c-bc8c-452f-8ff7-a70960cce2e3 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:43.141912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb72338c-bc8c-452f-8ff7-a70960cce2e3 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:43.142696 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb72338c-bc8c-452f-8ff7-a70960cce2e3 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:43.143128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb72338c-bc8c-452f-8ff7-a70960cce2e3 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:43.157779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-fb72338c-bc8c-452f-8ff7-a70960cce2e3 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] HTTP exception thrown: Instance 24361d41-5ef8-4321-83a7-78a2343df7cf could not be found. Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fb72338c-bc8c-452f-8ff7-a70960cce2e3 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Request method failure captured: Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf HTTP/1.1 Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PMdIK0w7vSPLaR54OOtGAFTQnCSeHXfYATc-_I_iu3lhz__OHYkXUUiI-pKu2aQCNye3gOUmDRKHsjs8KX9LmsPoLJl9EkYxFw2cApidPwtOxN2SXfSn4kMWRxTKkw0rdSi6-t0jSVR2ld3JPXDSJ6-HcBe1k50nbBhs35-N_qvm8I Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: eb38392ff9294ce08fb43f32f6176c4c Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-VolumesNegativeTest-283258533 Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:33:43.160375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb38392ff9294ce08fb43f32f6176c4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb38392ff9294ce08fb43f32f6176c4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb38392ff9294ce08fb43f32f6176c4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb38392ff9294ce08fb43f32f6176c4c"}]}] Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-VolumesNegativeTest-283258533 Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: eb38392ff9294ce08fb43f32f6176c4c Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-VolumesNegativeTest-283258533 Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-VolumesNegativeTest-283258533-project Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 7425f2b3ad664922961e848dfdd010d3 Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-VolumesNegativeTest-283258533-project Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance 24361d41-5ef8-4321-83a7-78a2343df7cf could not be found. Jul 21 06:33:43.161778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '24361d41-5ef8-4321-83a7-78a2343df7cf'} Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24361d41-5ef8-4321-83a7-78a2343df7cf could not be found. Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:33:43.162575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24361d41-5ef8-4321-83a7-78a2343df7cf could not be found. Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24361d41-5ef8-4321-83a7-78a2343df7cf could not be found. Jul 21 06:33:43.163783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:33:43.164884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fb72338c-bc8c-452f-8ff7-a70960cce2e3 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] Returning 404 to user: Instance 24361d41-5ef8-4321-83a7-78a2343df7cf could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:33:43.164884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fb72338c-bc8c-452f-8ff7-a70960cce2e3 tempest-VolumesNegativeTest-283258533 tempest-VolumesNegativeTest-283258533-project] 10.222.0.42 "GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf" status: 404 len: 111 microversion: 2.1 time: 0.033317 Jul 21 06:33:43.164884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 275/558] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:43 2022] GET /compute/v2.1/servers/24361d41-5ef8-4321-83a7-78a2343df7cf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:33:43.238470 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-58bb97be-fd0e-4fef-9c34-cdd6a423c48d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:43.240006 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-58bb97be-fd0e-4fef-9c34-cdd6a423c48d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:43.248099 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-58bb97be-fd0e-4fef-9c34-cdd6a423c48d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:43.248728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-58bb97be-fd0e-4fef-9c34-cdd6a423c48d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:43.249926 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-58bb97be-fd0e-4fef-9c34-cdd6a423c48d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:43.250395 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-58bb97be-fd0e-4fef-9c34-cdd6a423c48d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:43.406489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-58bb97be-fd0e-4fef-9c34-cdd6a423c48d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:43.417152 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-58bb97be-fd0e-4fef-9c34-cdd6a423c48d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:43.418830 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-58bb97be-fd0e-4fef-9c34-cdd6a423c48d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:43.420125 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-58bb97be-fd0e-4fef-9c34-cdd6a423c48d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.187289 Jul 21 06:33:43.420826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 284/559] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:43 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:43.438681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-33ebe3f5-742b-4b51-acf4-549adafe91d0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:43.439290 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-33ebe3f5-742b-4b51-acf4-549adafe91d0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:43.446422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-33ebe3f5-742b-4b51-acf4-549adafe91d0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:43.446866 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-33ebe3f5-742b-4b51-acf4-549adafe91d0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:43.447625 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-33ebe3f5-742b-4b51-acf4-549adafe91d0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:43.448052 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-33ebe3f5-742b-4b51-acf4-549adafe91d0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:43.526460 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-33ebe3f5-742b-4b51-acf4-549adafe91d0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:43.535445 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-33ebe3f5-742b-4b51-acf4-549adafe91d0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1277 microversion: 2.1 time: 0.100422 Jul 21 06:33:43.541624 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 276/560] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:43 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:44.404921 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-cae810d0-e022-4297-8a88-de1777fbc193 req-b296c4cd-c0a6-430c-b957-df10bd8af5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c3a3de3-c6af-4f50-b999-d47265b43595", "tag": "ec590c24-0627-4416-8dda-da4d559e2b05"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:44.417251 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-cae810d0-e022-4297-8a88-de1777fbc193 req-b296c4cd-c0a6-430c-b957-df10bd8af5ee service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:44.417929 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-cae810d0-e022-4297-8a88-de1777fbc193 req-b296c4cd-c0a6-430c-b957-df10bd8af5ee service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:44.439059 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-36953874-b572-417b-be11-d770a6e13dd3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:44.439668 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-cae810d0-e022-4297-8a88-de1777fbc193 req-b296c4cd-c0a6-430c-b957-df10bd8af5ee service nova] Creating event network-changed:ec590c24-0627-4416-8dda-da4d559e2b05 for instance 3c3a3de3-c6af-4f50-b999-d47265b43595 on hv-cinder-85031 Jul 21 06:33:44.439923 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-36953874-b572-417b-be11-d770a6e13dd3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:44.442194 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:44.442929 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=6 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:44.446862 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-cae810d0-e022-4297-8a88-de1777fbc193 req-b296c4cd-c0a6-430c-b957-df10bd8af5ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048859 Jul 21 06:33:44.447652 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 285/561] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:44.458670 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-36953874-b572-417b-be11-d770a6e13dd3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:44.459837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-36953874-b572-417b-be11-d770a6e13dd3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:44.461208 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-36953874-b572-417b-be11-d770a6e13dd3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:44.461894 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-36953874-b572-417b-be11-d770a6e13dd3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:44.553559 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7b7e2a0e-3a1c-4ef1-8d4c-ebcaa1886773 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:44.554323 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7b7e2a0e-3a1c-4ef1-8d4c-ebcaa1886773 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:44.563206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7b7e2a0e-3a1c-4ef1-8d4c-ebcaa1886773 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:44.563662 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7b7e2a0e-3a1c-4ef1-8d4c-ebcaa1886773 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:44.567105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7b7e2a0e-3a1c-4ef1-8d4c-ebcaa1886773 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:44.571366 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7b7e2a0e-3a1c-4ef1-8d4c-ebcaa1886773 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:44.639710 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:44.859405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-36953874-b572-417b-be11-d770a6e13dd3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:44.872294 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-36953874-b572-417b-be11-d770a6e13dd3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:44.874107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-36953874-b572-417b-be11-d770a6e13dd3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:44.883764 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-36953874-b572-417b-be11-d770a6e13dd3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.448560 Jul 21 06:33:44.885065 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 277/562] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:44 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:44.921019 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7b7e2a0e-3a1c-4ef1-8d4c-ebcaa1886773 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:44.936596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7b7e2a0e-3a1c-4ef1-8d4c-ebcaa1886773 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.387446 Jul 21 06:33:44.937197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 286/563] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:44 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:45.903733 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3e626259-c608-471c-8d53-ef3ee77a0136 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:45.904471 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3e626259-c608-471c-8d53-ef3ee77a0136 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:45.911219 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3e626259-c608-471c-8d53-ef3ee77a0136 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:45.911603 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3e626259-c608-471c-8d53-ef3ee77a0136 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:45.912375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3e626259-c608-471c-8d53-ef3ee77a0136 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:45.912827 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3e626259-c608-471c-8d53-ef3ee77a0136 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:45.954490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ac523b49-3dac-4ddd-82d4-f0f74abae077 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:45.955110 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ac523b49-3dac-4ddd-82d4-f0f74abae077 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:45.962835 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ac523b49-3dac-4ddd-82d4-f0f74abae077 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:45.968908 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ac523b49-3dac-4ddd-82d4-f0f74abae077 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:45.970052 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ac523b49-3dac-4ddd-82d4-f0f74abae077 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:45.970596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ac523b49-3dac-4ddd-82d4-f0f74abae077 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:46.190525 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3e626259-c608-471c-8d53-ef3ee77a0136 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:46.197982 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ac523b49-3dac-4ddd-82d4-f0f74abae077 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:46.200303 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3e626259-c608-471c-8d53-ef3ee77a0136 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:46.201926 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3e626259-c608-471c-8d53-ef3ee77a0136 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:46.203221 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3e626259-c608-471c-8d53-ef3ee77a0136 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.303433 Jul 21 06:33:46.203897 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 278/564] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:45 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:46.207939 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ac523b49-3dac-4ddd-82d4-f0f74abae077 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.259210 Jul 21 06:33:46.208709 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 287/565] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:45 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:46.484174 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-28b3848a-0555-4780-b313-237fe65a3f2f req-7b28fe3b-b850-477e-8115-3c4d0f221e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6957ca3e-0c2d-413b-bbb5-f77c452e0398", "tag": "47424985-5a53-4d8b-97b6-2f5bbea4e8da"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:46.492413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-28b3848a-0555-4780-b313-237fe65a3f2f req-7b28fe3b-b850-477e-8115-3c4d0f221e92 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:46.492851 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-28b3848a-0555-4780-b313-237fe65a3f2f req-7b28fe3b-b850-477e-8115-3c4d0f221e92 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:46.503718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-28b3848a-0555-4780-b313-237fe65a3f2f req-7b28fe3b-b850-477e-8115-3c4d0f221e92 service nova] Creating event network-changed:47424985-5a53-4d8b-97b6-2f5bbea4e8da for instance 6957ca3e-0c2d-413b-bbb5-f77c452e0398 on hv-cinder-85031 Jul 21 06:33:46.508610 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-28b3848a-0555-4780-b313-237fe65a3f2f req-7b28fe3b-b850-477e-8115-3c4d0f221e92 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028053 Jul 21 06:33:46.509170 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 279/566] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:33:47.222953 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-81563e10-7801-48de-b9cc-b02afc440ab9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:47.223564 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-81563e10-7801-48de-b9cc-b02afc440ab9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:47.225869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:47.226126 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a4da73bd-bbfd-4b1c-a9af-36aab7c2be73 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:47.226827 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a4da73bd-bbfd-4b1c-a9af-36aab7c2be73 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:47.231187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-81563e10-7801-48de-b9cc-b02afc440ab9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:47.231642 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-81563e10-7801-48de-b9cc-b02afc440ab9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:47.232418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-81563e10-7801-48de-b9cc-b02afc440ab9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:47.232858 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-81563e10-7801-48de-b9cc-b02afc440ab9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:47.233470 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a4da73bd-bbfd-4b1c-a9af-36aab7c2be73 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:47.234153 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a4da73bd-bbfd-4b1c-a9af-36aab7c2be73 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:47.234914 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a4da73bd-bbfd-4b1c-a9af-36aab7c2be73 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:47.235505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a4da73bd-bbfd-4b1c-a9af-36aab7c2be73 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:47.428257 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-81563e10-7801-48de-b9cc-b02afc440ab9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:47.435713 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a4da73bd-bbfd-4b1c-a9af-36aab7c2be73 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:47.437211 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-81563e10-7801-48de-b9cc-b02afc440ab9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:47.438767 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-81563e10-7801-48de-b9cc-b02afc440ab9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:47.441000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-81563e10-7801-48de-b9cc-b02afc440ab9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.221989 Jul 21 06:33:47.441563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 288/567] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:47 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:47.448638 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a4da73bd-bbfd-4b1c-a9af-36aab7c2be73 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.227928 Jul 21 06:33:47.449598 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 280/568] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:47 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:48.460554 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-37ea7f27-39fb-4ae2-b15f-69c8af1adaeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:48.461285 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-37ea7f27-39fb-4ae2-b15f-69c8af1adaeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:48.465252 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5d53e006-2a64-4ba1-aa0e-d2aa49efda03 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:48.465876 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5d53e006-2a64-4ba1-aa0e-d2aa49efda03 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:48.467931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-37ea7f27-39fb-4ae2-b15f-69c8af1adaeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:48.468385 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-37ea7f27-39fb-4ae2-b15f-69c8af1adaeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:48.469198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-37ea7f27-39fb-4ae2-b15f-69c8af1adaeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:48.469926 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-37ea7f27-39fb-4ae2-b15f-69c8af1adaeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:48.473643 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5d53e006-2a64-4ba1-aa0e-d2aa49efda03 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:48.474114 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5d53e006-2a64-4ba1-aa0e-d2aa49efda03 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:48.475228 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5d53e006-2a64-4ba1-aa0e-d2aa49efda03 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:48.475672 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5d53e006-2a64-4ba1-aa0e-d2aa49efda03 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:48.488878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:48.679734 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-37ea7f27-39fb-4ae2-b15f-69c8af1adaeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:48.689033 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-37ea7f27-39fb-4ae2-b15f-69c8af1adaeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:48.691145 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-37ea7f27-39fb-4ae2-b15f-69c8af1adaeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:48.692358 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-37ea7f27-39fb-4ae2-b15f-69c8af1adaeb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.236726 Jul 21 06:33:48.693094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 289/569] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:48 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:48.696428 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5d53e006-2a64-4ba1-aa0e-d2aa49efda03 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:48.704885 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5d53e006-2a64-4ba1-aa0e-d2aa49efda03 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.243456 Jul 21 06:33:48.705451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 281/570] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:48 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:49.711552 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dcf29a4f-576b-4eb4-9381-11a3134c63f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:49.712162 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dcf29a4f-576b-4eb4-9381-11a3134c63f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:49.718730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dcf29a4f-576b-4eb4-9381-11a3134c63f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:49.719212 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dcf29a4f-576b-4eb4-9381-11a3134c63f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:49.719977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dcf29a4f-576b-4eb4-9381-11a3134c63f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:49.720413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dcf29a4f-576b-4eb4-9381-11a3134c63f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:49.723113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-23852736-de61-4677-861f-963fd9f8724a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:49.723726 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-23852736-de61-4677-861f-963fd9f8724a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:49.730208 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-23852736-de61-4677-861f-963fd9f8724a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:49.730654 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-23852736-de61-4677-861f-963fd9f8724a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:49.731423 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-23852736-de61-4677-861f-963fd9f8724a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:49.731883 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-23852736-de61-4677-861f-963fd9f8724a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:50.150924 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dcf29a4f-576b-4eb4-9381-11a3134c63f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:50.154051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-23852736-de61-4677-861f-963fd9f8724a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:50.160077 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dcf29a4f-576b-4eb4-9381-11a3134c63f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:50.161709 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dcf29a4f-576b-4eb4-9381-11a3134c63f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:50.162503 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-23852736-de61-4677-861f-963fd9f8724a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.443133 Jul 21 06:33:50.162917 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dcf29a4f-576b-4eb4-9381-11a3134c63f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.455329 Jul 21 06:33:50.163669 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 282/571] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:49 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:50.163817 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 290/572] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:49 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:51.179574 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-db432581-7705-4365-959c-b957084f7374 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:51.180192 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-db432581-7705-4365-959c-b957084f7374 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:51.180319 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ec803404-c1e1-4f40-ac09-5878b1270187 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:51.180907 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ec803404-c1e1-4f40-ac09-5878b1270187 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:51.186742 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-db432581-7705-4365-959c-b957084f7374 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:51.187195 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-db432581-7705-4365-959c-b957084f7374 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:51.187388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec803404-c1e1-4f40-ac09-5878b1270187 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:51.187838 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec803404-c1e1-4f40-ac09-5878b1270187 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:51.187966 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-db432581-7705-4365-959c-b957084f7374 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:51.188407 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-db432581-7705-4365-959c-b957084f7374 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:51.188587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec803404-c1e1-4f40-ac09-5878b1270187 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:51.189017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec803404-c1e1-4f40-ac09-5878b1270187 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:51.376141 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-db432581-7705-4365-959c-b957084f7374 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:51.383381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ec803404-c1e1-4f40-ac09-5878b1270187 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:51.384277 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-db432581-7705-4365-959c-b957084f7374 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.208832 Jul 21 06:33:51.384851 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 283/573] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:51 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:51.392043 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ec803404-c1e1-4f40-ac09-5878b1270187 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:51.393554 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ec803404-c1e1-4f40-ac09-5878b1270187 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:51.395447 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ec803404-c1e1-4f40-ac09-5878b1270187 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.218324 Jul 21 06:33:51.395999 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 291/574] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:51 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:52.401587 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-610e00a3-cda7-4fa9-a2d9-25fffbc36e81 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:52.402136 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-610e00a3-cda7-4fa9-a2d9-25fffbc36e81 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:52.408861 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-610e00a3-cda7-4fa9-a2d9-25fffbc36e81 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:52.409311 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-610e00a3-cda7-4fa9-a2d9-25fffbc36e81 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:52.410129 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-610e00a3-cda7-4fa9-a2d9-25fffbc36e81 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:52.411658 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-610e00a3-cda7-4fa9-a2d9-25fffbc36e81 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:52.414654 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8a282d0d-5873-48d8-883c-51f81ec03c68 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:52.415264 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8a282d0d-5873-48d8-883c-51f81ec03c68 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:52.421589 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8a282d0d-5873-48d8-883c-51f81ec03c68 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:52.422068 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8a282d0d-5873-48d8-883c-51f81ec03c68 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:52.422834 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8a282d0d-5873-48d8-883c-51f81ec03c68 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:52.423272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8a282d0d-5873-48d8-883c-51f81ec03c68 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:52.607170 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-610e00a3-cda7-4fa9-a2d9-25fffbc36e81 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:52.610190 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8a282d0d-5873-48d8-883c-51f81ec03c68 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:52.615488 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-610e00a3-cda7-4fa9-a2d9-25fffbc36e81 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.217992 Jul 21 06:33:52.616056 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 284/575] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:52 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:52.618592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8a282d0d-5873-48d8-883c-51f81ec03c68 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:52.620113 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8a282d0d-5873-48d8-883c-51f81ec03c68 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:52.621274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8a282d0d-5873-48d8-883c-51f81ec03c68 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.211186 Jul 21 06:33:52.621827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 292/576] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:52 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:53.633372 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6decd11e-b8b1-4bca-bd60-f13fb8b7348b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:53.634253 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6decd11e-b8b1-4bca-bd60-f13fb8b7348b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:53.639103 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bb4e1de6-2e07-4530-976f-ef712275f9fe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:53.639714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bb4e1de6-2e07-4530-976f-ef712275f9fe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:53.640035 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6decd11e-b8b1-4bca-bd60-f13fb8b7348b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:53.640533 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6decd11e-b8b1-4bca-bd60-f13fb8b7348b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:53.641296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6decd11e-b8b1-4bca-bd60-f13fb8b7348b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:53.641728 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6decd11e-b8b1-4bca-bd60-f13fb8b7348b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:53.648244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bb4e1de6-2e07-4530-976f-ef712275f9fe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:53.648244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bb4e1de6-2e07-4530-976f-ef712275f9fe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:53.648244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bb4e1de6-2e07-4530-976f-ef712275f9fe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:53.648574 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bb4e1de6-2e07-4530-976f-ef712275f9fe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:53.835775 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6decd11e-b8b1-4bca-bd60-f13fb8b7348b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:53.843448 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bb4e1de6-2e07-4530-976f-ef712275f9fe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:53.845475 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6decd11e-b8b1-4bca-bd60-f13fb8b7348b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.217052 Jul 21 06:33:53.846270 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 285/577] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:53 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:53.852885 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bb4e1de6-2e07-4530-976f-ef712275f9fe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:53.854457 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bb4e1de6-2e07-4530-976f-ef712275f9fe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:53.855627 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bb4e1de6-2e07-4530-976f-ef712275f9fe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.220338 Jul 21 06:33:53.856174 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 293/578] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:53 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:54.863413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fcfd74cd-b8be-45d7-b700-bb8257e4a01a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:54.864022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fcfd74cd-b8be-45d7-b700-bb8257e4a01a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:54.871359 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fcfd74cd-b8be-45d7-b700-bb8257e4a01a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:54.871809 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fcfd74cd-b8be-45d7-b700-bb8257e4a01a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:54.872569 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fcfd74cd-b8be-45d7-b700-bb8257e4a01a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:54.873041 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fcfd74cd-b8be-45d7-b700-bb8257e4a01a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:54.874596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-701511a5-aeda-48d1-83b7-149c299b3f2a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:54.875211 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-701511a5-aeda-48d1-83b7-149c299b3f2a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:54.882744 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-701511a5-aeda-48d1-83b7-149c299b3f2a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:54.883193 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-701511a5-aeda-48d1-83b7-149c299b3f2a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:54.883983 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-701511a5-aeda-48d1-83b7-149c299b3f2a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:54.884418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-701511a5-aeda-48d1-83b7-149c299b3f2a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:55.057722 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fcfd74cd-b8be-45d7-b700-bb8257e4a01a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:55.065281 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fcfd74cd-b8be-45d7-b700-bb8257e4a01a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.205783 Jul 21 06:33:55.065969 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 286/579] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:54 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:55.079264 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-701511a5-aeda-48d1-83b7-149c299b3f2a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:55.088300 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-701511a5-aeda-48d1-83b7-149c299b3f2a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:55.089806 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-701511a5-aeda-48d1-83b7-149c299b3f2a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:55.090987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-701511a5-aeda-48d1-83b7-149c299b3f2a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.220649 Jul 21 06:33:55.091545 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 294/580] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:54 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:33:56.084436 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0233eb36-6b64-4559-927a-3a25d7b5f33f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:56.085038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0233eb36-6b64-4559-927a-3a25d7b5f33f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:56.091592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0233eb36-6b64-4559-927a-3a25d7b5f33f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:56.092038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0233eb36-6b64-4559-927a-3a25d7b5f33f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:56.092786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0233eb36-6b64-4559-927a-3a25d7b5f33f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:56.093217 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0233eb36-6b64-4559-927a-3a25d7b5f33f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:56.110716 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f12d2b14-134d-4558-964e-c58c2223dcf9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:56.111329 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f12d2b14-134d-4558-964e-c58c2223dcf9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:56.118737 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f12d2b14-134d-4558-964e-c58c2223dcf9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:56.119198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f12d2b14-134d-4558-964e-c58c2223dcf9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:56.119994 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f12d2b14-134d-4558-964e-c58c2223dcf9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:56.120436 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f12d2b14-134d-4558-964e-c58c2223dcf9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:56.300138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0233eb36-6b64-4559-927a-3a25d7b5f33f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:56.307556 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f12d2b14-134d-4558-964e-c58c2223dcf9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:56.308473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0233eb36-6b64-4559-927a-3a25d7b5f33f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.228878 Jul 21 06:33:56.309049 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 287/581] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:56 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:56.315941 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f12d2b14-134d-4558-964e-c58c2223dcf9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:56.318079 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f12d2b14-134d-4558-964e-c58c2223dcf9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:56.319358 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f12d2b14-134d-4558-964e-c58c2223dcf9 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.214609 Jul 21 06:33:56.320080 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 295/582] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:56 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:56.769391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-60f0f5c5-987a-4109-ba9e-646a3b72b53a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09f931a3-5e05-40f8-8ddc-108c279ad49d"}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:33:56.770572 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-60f0f5c5-987a-4109-ba9e-646a3b72b53a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:56.776936 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-60f0f5c5-987a-4109-ba9e-646a3b72b53a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:56.777382 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-60f0f5c5-987a-4109-ba9e-646a3b72b53a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:56.778162 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-60f0f5c5-987a-4109-ba9e-646a3b72b53a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:56.778597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-60f0f5c5-987a-4109-ba9e-646a3b72b53a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:56.782205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:33:57.326490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4cebbb34-0fd4-43c3-a892-f0d36648b669 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:57.327054 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4cebbb34-0fd4-43c3-a892-f0d36648b669 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:57.333484 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4cebbb34-0fd4-43c3-a892-f0d36648b669 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:57.334059 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4cebbb34-0fd4-43c3-a892-f0d36648b669 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:57.334818 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4cebbb34-0fd4-43c3-a892-f0d36648b669 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:57.335247 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4cebbb34-0fd4-43c3-a892-f0d36648b669 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:57.468377 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-4cebbb34-0fd4-43c3-a892-f0d36648b669 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:57.476495 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4cebbb34-0fd4-43c3-a892-f0d36648b669 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.153988 Jul 21 06:33:57.477066 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 296/583] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:57 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:57.481384 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f060b979-9f44-497c-8c5c-d72b5803134b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:57.482002 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f060b979-9f44-497c-8c5c-d72b5803134b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:57.487527 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f060b979-9f44-497c-8c5c-d72b5803134b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:57.487976 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f060b979-9f44-497c-8c5c-d72b5803134b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:57.488736 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f060b979-9f44-497c-8c5c-d72b5803134b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:57.489174 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f060b979-9f44-497c-8c5c-d72b5803134b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:57.615945 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f060b979-9f44-497c-8c5c-d72b5803134b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:57.624500 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f060b979-9f44-497c-8c5c-d72b5803134b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:57.626056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f060b979-9f44-497c-8c5c-d72b5803134b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:57.627221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f060b979-9f44-497c-8c5c-d72b5803134b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.149244 Jul 21 06:33:57.627788 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 297/584] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:57 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:58.494376 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ca9e3a6d-f3d9-4828-ba7b-578b86bec3bb tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:58.494983 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ca9e3a6d-f3d9-4828-ba7b-578b86bec3bb tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:58.501734 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca9e3a6d-f3d9-4828-ba7b-578b86bec3bb tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:58.502384 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca9e3a6d-f3d9-4828-ba7b-578b86bec3bb tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:58.503172 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca9e3a6d-f3d9-4828-ba7b-578b86bec3bb tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:58.503685 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca9e3a6d-f3d9-4828-ba7b-578b86bec3bb tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:58.654143 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ca9e3a6d-f3d9-4828-ba7b-578b86bec3bb tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:58.662319 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ca9e3a6d-f3d9-4828-ba7b-578b86bec3bb tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.172088 Jul 21 06:33:58.662908 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 298/585] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:58 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:33:58.667244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-78d9b6d5-9543-409d-852e-b1ae15647487 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:58.667880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-78d9b6d5-9543-409d-852e-b1ae15647487 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:58.673360 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-78d9b6d5-9543-409d-852e-b1ae15647487 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:58.673810 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-78d9b6d5-9543-409d-852e-b1ae15647487 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:58.674610 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-78d9b6d5-9543-409d-852e-b1ae15647487 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:58.675046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-78d9b6d5-9543-409d-852e-b1ae15647487 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:58.805272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-78d9b6d5-9543-409d-852e-b1ae15647487 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:58.813705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-78d9b6d5-9543-409d-852e-b1ae15647487 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:58.815251 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-78d9b6d5-9543-409d-852e-b1ae15647487 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:58.816414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-78d9b6d5-9543-409d-852e-b1ae15647487 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.152593 Jul 21 06:33:58.816985 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 299/586] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:58 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:33:59.679958 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2ff810c4-6d83-43cd-bdda-7f10bd2346ff tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:59.680573 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2ff810c4-6d83-43cd-bdda-7f10bd2346ff tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:59.686979 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2ff810c4-6d83-43cd-bdda-7f10bd2346ff tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:59.687436 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2ff810c4-6d83-43cd-bdda-7f10bd2346ff tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:59.688212 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2ff810c4-6d83-43cd-bdda-7f10bd2346ff tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:59.688698 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2ff810c4-6d83-43cd-bdda-7f10bd2346ff tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:59.815382 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2ff810c4-6d83-43cd-bdda-7f10bd2346ff tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:59.822926 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2ff810c4-6d83-43cd-bdda-7f10bd2346ff tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.147700 Jul 21 06:33:59.823488 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 300/587] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:33:59 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:33:59.834325 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-19757c84-7d27-45a0-b979-f50bfb327ee0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:33:59.834936 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-19757c84-7d27-45a0-b979-f50bfb327ee0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:33:59.840659 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-19757c84-7d27-45a0-b979-f50bfb327ee0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:59.841110 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-19757c84-7d27-45a0-b979-f50bfb327ee0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:59.841876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-19757c84-7d27-45a0-b979-f50bfb327ee0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:33:59.842342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-19757c84-7d27-45a0-b979-f50bfb327ee0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:33:59.976530 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-19757c84-7d27-45a0-b979-f50bfb327ee0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:59.985067 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-19757c84-7d27-45a0-b979-f50bfb327ee0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:59.986632 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-19757c84-7d27-45a0-b979-f50bfb327ee0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:33:59.987931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-19757c84-7d27-45a0-b979-f50bfb327ee0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.157282 Jul 21 06:33:59.988502 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 301/588] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:33:59 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:34:00.840006 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-aeda4654-af13-458a-9cb6-43ea5b4e4f09 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:00.840699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-aeda4654-af13-458a-9cb6-43ea5b4e4f09 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:00.847145 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aeda4654-af13-458a-9cb6-43ea5b4e4f09 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:00.847596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aeda4654-af13-458a-9cb6-43ea5b4e4f09 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:00.848359 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aeda4654-af13-458a-9cb6-43ea5b4e4f09 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:00.849446 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aeda4654-af13-458a-9cb6-43ea5b4e4f09 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:00.984819 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-aeda4654-af13-458a-9cb6-43ea5b4e4f09 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:00.992244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-aeda4654-af13-458a-9cb6-43ea5b4e4f09 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.156101 Jul 21 06:34:00.992828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 302/589] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:00 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:01.006318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a3c56b3b-7cfd-49e5-9cf3-ef0b53044a64 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:01.006917 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a3c56b3b-7cfd-49e5-9cf3-ef0b53044a64 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:01.012499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a3c56b3b-7cfd-49e5-9cf3-ef0b53044a64 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:01.012947 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a3c56b3b-7cfd-49e5-9cf3-ef0b53044a64 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:01.013702 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a3c56b3b-7cfd-49e5-9cf3-ef0b53044a64 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:01.014168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a3c56b3b-7cfd-49e5-9cf3-ef0b53044a64 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:01.146452 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a3c56b3b-7cfd-49e5-9cf3-ef0b53044a64 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:01.155047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a3c56b3b-7cfd-49e5-9cf3-ef0b53044a64 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:01.156559 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a3c56b3b-7cfd-49e5-9cf3-ef0b53044a64 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:01.157713 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a3c56b3b-7cfd-49e5-9cf3-ef0b53044a64 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.155475 Jul 21 06:34:01.158308 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 303/590] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:34:01 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:34:01.808569 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-60f0f5c5-987a-4109-ba9e-646a3b72b53a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.042935 Jul 21 06:34:01.815140 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 288/591] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:33:56 2022] POST /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments => generated 194 bytes in 5050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:02.009153 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b8fb44b3-16ec-4020-8395-96b443d3f81b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:02.009772 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b8fb44b3-16ec-4020-8395-96b443d3f81b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:02.016560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b8fb44b3-16ec-4020-8395-96b443d3f81b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:02.017011 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b8fb44b3-16ec-4020-8395-96b443d3f81b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:02.017782 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b8fb44b3-16ec-4020-8395-96b443d3f81b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:02.018427 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b8fb44b3-16ec-4020-8395-96b443d3f81b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:02.178044 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5cf2145d-3f87-4456-bc1e-56b28b1353d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:02.178802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5cf2145d-3f87-4456-bc1e-56b28b1353d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:02.185823 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5cf2145d-3f87-4456-bc1e-56b28b1353d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:02.186304 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5cf2145d-3f87-4456-bc1e-56b28b1353d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:02.187079 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5cf2145d-3f87-4456-bc1e-56b28b1353d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:02.187550 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5cf2145d-3f87-4456-bc1e-56b28b1353d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:02.217388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b8fb44b3-16ec-4020-8395-96b443d3f81b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:02.225849 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b8fb44b3-16ec-4020-8395-96b443d3f81b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.220945 Jul 21 06:34:02.226547 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 304/592] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:02 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:02.361376 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5cf2145d-3f87-4456-bc1e-56b28b1353d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:02.370384 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5cf2145d-3f87-4456-bc1e-56b28b1353d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:02.371883 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5cf2145d-3f87-4456-bc1e-56b28b1353d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:02.373032 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5cf2145d-3f87-4456-bc1e-56b28b1353d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.200630 Jul 21 06:34:02.373597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 289/593] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:34:02 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:34:03.243955 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-06c63523-b2ec-4a09-97f5-e21b654b574b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:03.244584 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-06c63523-b2ec-4a09-97f5-e21b654b574b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:03.251391 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-06c63523-b2ec-4a09-97f5-e21b654b574b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:03.251842 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-06c63523-b2ec-4a09-97f5-e21b654b574b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:03.252621 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-06c63523-b2ec-4a09-97f5-e21b654b574b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:03.253060 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-06c63523-b2ec-4a09-97f5-e21b654b574b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:03.391606 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1f32f48d-2ff6-4e69-ac88-d89467affd3c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:03.393304 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1f32f48d-2ff6-4e69-ac88-d89467affd3c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:03.401168 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1f32f48d-2ff6-4e69-ac88-d89467affd3c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:03.401686 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1f32f48d-2ff6-4e69-ac88-d89467affd3c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:03.402568 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1f32f48d-2ff6-4e69-ac88-d89467affd3c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:03.403065 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1f32f48d-2ff6-4e69-ac88-d89467affd3c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:03.403162 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-06c63523-b2ec-4a09-97f5-e21b654b574b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:03.410836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-06c63523-b2ec-4a09-97f5-e21b654b574b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.171705 Jul 21 06:34:03.412370 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 305/594] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:03 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:03.541903 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1f32f48d-2ff6-4e69-ac88-d89467affd3c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:03.550299 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1f32f48d-2ff6-4e69-ac88-d89467affd3c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:03.552549 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1f32f48d-2ff6-4e69-ac88-d89467affd3c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:03.553713 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1f32f48d-2ff6-4e69-ac88-d89467affd3c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.165943 Jul 21 06:34:03.554308 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 290/595] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:34:03 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:34:04.428658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-decf40c8-f70c-4887-9657-5bd93dd4a2c5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:04.429300 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-decf40c8-f70c-4887-9657-5bd93dd4a2c5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:04.435813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-decf40c8-f70c-4887-9657-5bd93dd4a2c5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:04.436263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-decf40c8-f70c-4887-9657-5bd93dd4a2c5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:04.437022 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-decf40c8-f70c-4887-9657-5bd93dd4a2c5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:04.437462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-decf40c8-f70c-4887-9657-5bd93dd4a2c5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:04.441472 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:04.573680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-950789bd-c98e-4f1d-bbc1-f19dee66eea3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:04.574362 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-950789bd-c98e-4f1d-bbc1-f19dee66eea3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:04.577570 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=58 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:04.578473 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-decf40c8-f70c-4887-9657-5bd93dd4a2c5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:04.582491 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-950789bd-c98e-4f1d-bbc1-f19dee66eea3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:04.583497 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-950789bd-c98e-4f1d-bbc1-f19dee66eea3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:04.584288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-950789bd-c98e-4f1d-bbc1-f19dee66eea3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:04.584763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-950789bd-c98e-4f1d-bbc1-f19dee66eea3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:04.588158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-decf40c8-f70c-4887-9657-5bd93dd4a2c5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.163265 Jul 21 06:34:04.588756 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 306/596] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:04 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:04.719097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-950789bd-c98e-4f1d-bbc1-f19dee66eea3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:04.728465 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-950789bd-c98e-4f1d-bbc1-f19dee66eea3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:04.730018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-950789bd-c98e-4f1d-bbc1-f19dee66eea3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:04.731204 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-950789bd-c98e-4f1d-bbc1-f19dee66eea3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.161679 Jul 21 06:34:04.731766 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 291/597] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:34:04 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:34:05.605021 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8e1c9a56-7b1c-4c6a-b623-8c1dbb7b2444 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:05.605832 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8e1c9a56-7b1c-4c6a-b623-8c1dbb7b2444 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:05.612512 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8e1c9a56-7b1c-4c6a-b623-8c1dbb7b2444 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:05.612966 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8e1c9a56-7b1c-4c6a-b623-8c1dbb7b2444 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:05.613732 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8e1c9a56-7b1c-4c6a-b623-8c1dbb7b2444 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:05.614311 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8e1c9a56-7b1c-4c6a-b623-8c1dbb7b2444 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:05.749554 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8e1c9a56-7b1c-4c6a-b623-8c1dbb7b2444 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:05.750488 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9bb7fa97-db04-47d3-b383-681ab7720b86 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:05.751112 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9bb7fa97-db04-47d3-b383-681ab7720b86 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:05.757861 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8e1c9a56-7b1c-4c6a-b623-8c1dbb7b2444 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.156617 Jul 21 06:34:05.758422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9bb7fa97-db04-47d3-b383-681ab7720b86 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:05.758608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 307/598] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:05 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:05.758955 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9bb7fa97-db04-47d3-b383-681ab7720b86 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:05.759810 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9bb7fa97-db04-47d3-b383-681ab7720b86 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:05.760255 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9bb7fa97-db04-47d3-b383-681ab7720b86 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:05.906069 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9bb7fa97-db04-47d3-b383-681ab7720b86 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:05.914778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9bb7fa97-db04-47d3-b383-681ab7720b86 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:05.916599 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9bb7fa97-db04-47d3-b383-681ab7720b86 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:05.918013 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9bb7fa97-db04-47d3-b383-681ab7720b86 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.171459 Jul 21 06:34:05.918589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 292/599] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:34:05 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:34:06.110581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-7a9d4ff8-eb3d-43a9-ac6b-1ab84624cb2a req-4dbec2d0-dd19-4851-a437-18d13c6087c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40d32b1-a161-49f9-a2ae-fe794e9a66cd", "name": "network-vif-plugged", "status": "completed", "tag": "345fc32c-f55c-4636-be16-4b276cd0c105"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:06.120889 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-7a9d4ff8-eb3d-43a9-ac6b-1ab84624cb2a req-4dbec2d0-dd19-4851-a437-18d13c6087c7 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:06.121610 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-7a9d4ff8-eb3d-43a9-ac6b-1ab84624cb2a req-4dbec2d0-dd19-4851-a437-18d13c6087c7 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:06.135126 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-7a9d4ff8-eb3d-43a9-ac6b-1ab84624cb2a req-4dbec2d0-dd19-4851-a437-18d13c6087c7 service nova] Creating event network-vif-plugged:345fc32c-f55c-4636-be16-4b276cd0c105 for instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd on hv-cinder-85031 Jul 21 06:34:06.140289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-7a9d4ff8-eb3d-43a9-ac6b-1ab84624cb2a req-4dbec2d0-dd19-4851-a437-18d13c6087c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034815 Jul 21 06:34:06.141354 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 308/600] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:06.775717 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5f194e57-8d30-44e8-b482-c2ac1fee9a30 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:06.776404 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5f194e57-8d30-44e8-b482-c2ac1fee9a30 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:06.783743 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f194e57-8d30-44e8-b482-c2ac1fee9a30 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:06.784398 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f194e57-8d30-44e8-b482-c2ac1fee9a30 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:06.785175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f194e57-8d30-44e8-b482-c2ac1fee9a30 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:06.785606 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5f194e57-8d30-44e8-b482-c2ac1fee9a30 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:06.919853 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5f194e57-8d30-44e8-b482-c2ac1fee9a30 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:06.927976 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5f194e57-8d30-44e8-b482-c2ac1fee9a30 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.156276 Jul 21 06:34:06.928546 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 293/601] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:06 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:06.937550 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a1b7d33b-817b-4eb2-a75d-3d30ef143d5d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:06.938286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a1b7d33b-817b-4eb2-a75d-3d30ef143d5d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:06.945409 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a1b7d33b-817b-4eb2-a75d-3d30ef143d5d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:06.945858 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a1b7d33b-817b-4eb2-a75d-3d30ef143d5d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:06.946657 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a1b7d33b-817b-4eb2-a75d-3d30ef143d5d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:06.947085 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a1b7d33b-817b-4eb2-a75d-3d30ef143d5d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:07.078973 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a1b7d33b-817b-4eb2-a75d-3d30ef143d5d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:07.088014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a1b7d33b-817b-4eb2-a75d-3d30ef143d5d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:07.089522 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a1b7d33b-817b-4eb2-a75d-3d30ef143d5d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:07.090717 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a1b7d33b-817b-4eb2-a75d-3d30ef143d5d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.157862 Jul 21 06:34:07.091276 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 309/602] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:34:06 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:34:07.945202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-32f0c96e-649a-47c1-815f-0b648d3e9041 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:07.946178 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-32f0c96e-649a-47c1-815f-0b648d3e9041 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:07.952754 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-32f0c96e-649a-47c1-815f-0b648d3e9041 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:07.953203 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-32f0c96e-649a-47c1-815f-0b648d3e9041 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:07.953997 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-32f0c96e-649a-47c1-815f-0b648d3e9041 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:07.954439 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-32f0c96e-649a-47c1-815f-0b648d3e9041 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:08.088601 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-32f0c96e-649a-47c1-815f-0b648d3e9041 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:08.097004 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-32f0c96e-649a-47c1-815f-0b648d3e9041 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.156392 Jul 21 06:34:08.097726 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 294/603] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:07 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:08.108757 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9608fa9a-6154-4305-b7e5-b16379df633d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:08.109639 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9608fa9a-6154-4305-b7e5-b16379df633d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:08.116463 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9608fa9a-6154-4305-b7e5-b16379df633d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:08.116912 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9608fa9a-6154-4305-b7e5-b16379df633d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:08.117683 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9608fa9a-6154-4305-b7e5-b16379df633d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:08.118270 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9608fa9a-6154-4305-b7e5-b16379df633d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:08.164363 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-e267dc2c-6d88-4223-91cb-1194a1181c21 req-f27d8659-e1dc-46e3-b920-9000914b50f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6957ca3e-0c2d-413b-bbb5-f77c452e0398", "name": "network-vif-plugged", "status": "completed", "tag": "47424985-5a53-4d8b-97b6-2f5bbea4e8da"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:08.173966 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-e267dc2c-6d88-4223-91cb-1194a1181c21 req-f27d8659-e1dc-46e3-b920-9000914b50f5 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:08.174420 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-e267dc2c-6d88-4223-91cb-1194a1181c21 req-f27d8659-e1dc-46e3-b920-9000914b50f5 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:08.187954 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-e267dc2c-6d88-4223-91cb-1194a1181c21 req-f27d8659-e1dc-46e3-b920-9000914b50f5 service nova] Creating event network-vif-plugged:47424985-5a53-4d8b-97b6-2f5bbea4e8da for instance 6957ca3e-0c2d-413b-bbb5-f77c452e0398 on hv-cinder-85031 Jul 21 06:34:08.194084 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-e267dc2c-6d88-4223-91cb-1194a1181c21 req-f27d8659-e1dc-46e3-b920-9000914b50f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033348 Jul 21 06:34:08.194860 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 295/604] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:08.256653 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9608fa9a-6154-4305-b7e5-b16379df633d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:08.265042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9608fa9a-6154-4305-b7e5-b16379df633d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:08.266640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9608fa9a-6154-4305-b7e5-b16379df633d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:08.267797 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9608fa9a-6154-4305-b7e5-b16379df633d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.163144 Jul 21 06:34:08.268349 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 310/605] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:34:08 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:34:09.115107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d488e12c-302b-4059-ac3b-d534052a5254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:09.115777 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d488e12c-302b-4059-ac3b-d534052a5254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:09.122464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d488e12c-302b-4059-ac3b-d534052a5254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:09.122907 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d488e12c-302b-4059-ac3b-d534052a5254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:09.123662 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d488e12c-302b-4059-ac3b-d534052a5254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:09.124233 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d488e12c-302b-4059-ac3b-d534052a5254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:09.271719 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d488e12c-302b-4059-ac3b-d534052a5254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:09.279611 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d488e12c-302b-4059-ac3b-d534052a5254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.168778 Jul 21 06:34:09.280189 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 296/606] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:09 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:09.286405 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e95df242-21e2-4d24-817a-40100ed50536 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:09.287183 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e95df242-21e2-4d24-817a-40100ed50536 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:09.294172 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e95df242-21e2-4d24-817a-40100ed50536 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:09.294638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e95df242-21e2-4d24-817a-40100ed50536 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:09.295413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e95df242-21e2-4d24-817a-40100ed50536 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:09.295853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e95df242-21e2-4d24-817a-40100ed50536 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:09.423996 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e95df242-21e2-4d24-817a-40100ed50536 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:09.433103 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e95df242-21e2-4d24-817a-40100ed50536 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:09.434794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e95df242-21e2-4d24-817a-40100ed50536 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:09.435962 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e95df242-21e2-4d24-817a-40100ed50536 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1810 microversion: 2.20 time: 0.153611 Jul 21 06:34:09.436540 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 311/607] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:34:09 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:34:10.298027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-00995bd0-2e0c-4743-8080-65ee257a6580 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:10.298637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-00995bd0-2e0c-4743-8080-65ee257a6580 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:10.306467 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-00995bd0-2e0c-4743-8080-65ee257a6580 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:10.306917 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-00995bd0-2e0c-4743-8080-65ee257a6580 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:10.307792 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-00995bd0-2e0c-4743-8080-65ee257a6580 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:10.308172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-00995bd0-2e0c-4743-8080-65ee257a6580 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:10.413022 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bcef62ed-b10c-46a6-a992-26dd75c7a41b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:10.414001 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bcef62ed-b10c-46a6-a992-26dd75c7a41b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:10.420414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bcef62ed-b10c-46a6-a992-26dd75c7a41b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:10.420879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bcef62ed-b10c-46a6-a992-26dd75c7a41b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:10.421657 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bcef62ed-b10c-46a6-a992-26dd75c7a41b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:10.422129 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bcef62ed-b10c-46a6-a992-26dd75c7a41b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:10.439455 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-00995bd0-2e0c-4743-8080-65ee257a6580 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:10.445442 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-bcef62ed-b10c-46a6-a992-26dd75c7a41b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lazy-loading 'flavor' on Instance uuid 6d312821-22fc-4f7a-9a04-88f677a66511 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:34:10.447518 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-00995bd0-2e0c-4743-8080-65ee257a6580 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.153296 Jul 21 06:34:10.448306 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 297/608] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:10 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:10.453965 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a4bdb6bf-9fa8-46a3-8969-943747586a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:10.454598 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a4bdb6bf-9fa8-46a3-8969-943747586a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:10.460504 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a4bdb6bf-9fa8-46a3-8969-943747586a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:10.460993 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a4bdb6bf-9fa8-46a3-8969-943747586a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:10.461849 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a4bdb6bf-9fa8-46a3-8969-943747586a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:10.462310 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a4bdb6bf-9fa8-46a3-8969-943747586a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:10.571342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bcef62ed-b10c-46a6-a992-26dd75c7a41b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/action" status: 200 len: 32 microversion: 2.1 time: 0.162685 Jul 21 06:34:10.571927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 312/609] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:34:10 2022] POST /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 06:34:10.581851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-926c911f-7970-487b-b92b-a80cceda063c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:10.582624 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-926c911f-7970-487b-b92b-a80cceda063c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:10.591633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-926c911f-7970-487b-b92b-a80cceda063c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:10.592099 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-926c911f-7970-487b-b92b-a80cceda063c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:10.592948 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-926c911f-7970-487b-b92b-a80cceda063c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:10.593394 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-926c911f-7970-487b-b92b-a80cceda063c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:10.597691 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a4bdb6bf-9fa8-46a3-8969-943747586a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:10.606439 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a4bdb6bf-9fa8-46a3-8969-943747586a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:10.607952 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a4bdb6bf-9fa8-46a3-8969-943747586a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:10.609112 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a4bdb6bf-9fa8-46a3-8969-943747586a9d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1797 microversion: 2.20 time: 0.158884 Jul 21 06:34:10.609674 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 298/610] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:34:10 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1797 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:34:10.787850 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-926c911f-7970-487b-b92b-a80cceda063c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:10.796703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-926c911f-7970-487b-b92b-a80cceda063c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.219323 Jul 21 06:34:10.797297 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 313/611] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:10 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:11.465276 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f35e499b-c1a4-4d67-b19d-e4658fb0b05d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:11.466423 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f35e499b-c1a4-4d67-b19d-e4658fb0b05d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:11.472802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f35e499b-c1a4-4d67-b19d-e4658fb0b05d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:11.473253 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f35e499b-c1a4-4d67-b19d-e4658fb0b05d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:11.474713 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f35e499b-c1a4-4d67-b19d-e4658fb0b05d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:11.475151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f35e499b-c1a4-4d67-b19d-e4658fb0b05d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:11.610471 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f35e499b-c1a4-4d67-b19d-e4658fb0b05d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:11.618712 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f35e499b-c1a4-4d67-b19d-e4658fb0b05d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1319 microversion: 2.1 time: 0.157622 Jul 21 06:34:11.619288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 299/612] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:11 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:11.815250 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-76310311-0e4c-454e-8ec4-571d44889a04 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:11.815770 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-76310311-0e4c-454e-8ec4-571d44889a04 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:11.822298 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76310311-0e4c-454e-8ec4-571d44889a04 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:11.822753 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76310311-0e4c-454e-8ec4-571d44889a04 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:11.823523 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76310311-0e4c-454e-8ec4-571d44889a04 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:11.823962 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76310311-0e4c-454e-8ec4-571d44889a04 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:11.955753 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-76310311-0e4c-454e-8ec4-571d44889a04 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:11.964259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-76310311-0e4c-454e-8ec4-571d44889a04 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.152984 Jul 21 06:34:11.964823 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 314/613] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:11 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:12.635597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-000f3b37-5a7a-4435-8039-e48b9a1e751f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:12.636204 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-000f3b37-5a7a-4435-8039-e48b9a1e751f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:12.642690 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-000f3b37-5a7a-4435-8039-e48b9a1e751f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:12.643136 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-000f3b37-5a7a-4435-8039-e48b9a1e751f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:12.643894 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-000f3b37-5a7a-4435-8039-e48b9a1e751f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:12.644325 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-000f3b37-5a7a-4435-8039-e48b9a1e751f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:12.775068 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-000f3b37-5a7a-4435-8039-e48b9a1e751f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:12.782806 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-000f3b37-5a7a-4435-8039-e48b9a1e751f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1506 microversion: 2.1 time: 0.151064 Jul 21 06:34:12.783379 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 300/614] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:12 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:12.981340 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ced92362-6860-4381-8ee6-2b32d5c96805 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:12.981973 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ced92362-6860-4381-8ee6-2b32d5c96805 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:12.988961 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ced92362-6860-4381-8ee6-2b32d5c96805 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:12.989950 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ced92362-6860-4381-8ee6-2b32d5c96805 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:12.991040 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ced92362-6860-4381-8ee6-2b32d5c96805 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:12.991652 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ced92362-6860-4381-8ee6-2b32d5c96805 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:13.128603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ced92362-6860-4381-8ee6-2b32d5c96805 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:13.137525 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ced92362-6860-4381-8ee6-2b32d5c96805 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.159878 Jul 21 06:34:13.138333 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 315/615] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:12 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:14.155747 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d37f99f4-151e-4d98-9a63-01a2b1ea1142 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:14.156363 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d37f99f4-151e-4d98-9a63-01a2b1ea1142 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:14.162898 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d37f99f4-151e-4d98-9a63-01a2b1ea1142 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:14.163353 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d37f99f4-151e-4d98-9a63-01a2b1ea1142 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:14.164128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d37f99f4-151e-4d98-9a63-01a2b1ea1142 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:14.164558 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d37f99f4-151e-4d98-9a63-01a2b1ea1142 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:14.297011 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d37f99f4-151e-4d98-9a63-01a2b1ea1142 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:14.305919 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d37f99f4-151e-4d98-9a63-01a2b1ea1142 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.154072 Jul 21 06:34:14.306498 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 301/616] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:14 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:15.322677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5446e3ee-f225-4e37-8908-f66cfb612e40 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:15.323291 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5446e3ee-f225-4e37-8908-f66cfb612e40 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:15.329741 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5446e3ee-f225-4e37-8908-f66cfb612e40 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:15.330214 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5446e3ee-f225-4e37-8908-f66cfb612e40 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:15.330997 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5446e3ee-f225-4e37-8908-f66cfb612e40 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:15.331434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5446e3ee-f225-4e37-8908-f66cfb612e40 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:15.467898 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5446e3ee-f225-4e37-8908-f66cfb612e40 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:15.476775 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5446e3ee-f225-4e37-8908-f66cfb612e40 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.158048 Jul 21 06:34:15.477562 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 316/617] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:15 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:16.495112 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-83e6fad8-3621-42e5-8398-60ebe621d99e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:16.495724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-83e6fad8-3621-42e5-8398-60ebe621d99e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:16.502595 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-83e6fad8-3621-42e5-8398-60ebe621d99e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:16.503044 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-83e6fad8-3621-42e5-8398-60ebe621d99e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:16.503810 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-83e6fad8-3621-42e5-8398-60ebe621d99e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:16.504245 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-83e6fad8-3621-42e5-8398-60ebe621d99e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:16.643403 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-83e6fad8-3621-42e5-8398-60ebe621d99e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:16.651753 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-83e6fad8-3621-42e5-8398-60ebe621d99e tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.160538 Jul 21 06:34:16.652347 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 302/618] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:16 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:17.669377 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2e378337-3910-438c-8be3-86601744b7a8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:17.670031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2e378337-3910-438c-8be3-86601744b7a8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:17.673216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=58 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:17.678765 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2e378337-3910-438c-8be3-86601744b7a8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:17.679211 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2e378337-3910-438c-8be3-86601744b7a8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:17.679969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2e378337-3910-438c-8be3-86601744b7a8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:17.680402 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2e378337-3910-438c-8be3-86601744b7a8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:17.811511 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2e378337-3910-438c-8be3-86601744b7a8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:17.821166 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2e378337-3910-438c-8be3-86601744b7a8 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.155812 Jul 21 06:34:17.821874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 317/619] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:17 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:18.838465 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ca23c88d-42a1-48c9-bfaf-a3fa90363627 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:18.839071 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ca23c88d-42a1-48c9-bfaf-a3fa90363627 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:18.845540 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ca23c88d-42a1-48c9-bfaf-a3fa90363627 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:18.846017 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ca23c88d-42a1-48c9-bfaf-a3fa90363627 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:18.846772 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ca23c88d-42a1-48c9-bfaf-a3fa90363627 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:18.847207 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ca23c88d-42a1-48c9-bfaf-a3fa90363627 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:18.985663 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ca23c88d-42a1-48c9-bfaf-a3fa90363627 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:18.994153 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ca23c88d-42a1-48c9-bfaf-a3fa90363627 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.159576 Jul 21 06:34:18.994721 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 303/620] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:18 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:20.011869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-355859ed-e299-4c7e-be55-bfb97704e596 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:20.012483 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-355859ed-e299-4c7e-be55-bfb97704e596 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:20.018976 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-355859ed-e299-4c7e-be55-bfb97704e596 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:20.019416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-355859ed-e299-4c7e-be55-bfb97704e596 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:20.020167 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-355859ed-e299-4c7e-be55-bfb97704e596 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:20.020599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-355859ed-e299-4c7e-be55-bfb97704e596 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:20.156063 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-355859ed-e299-4c7e-be55-bfb97704e596 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:20.165656 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-355859ed-e299-4c7e-be55-bfb97704e596 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.157583 Jul 21 06:34:20.166252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 318/621] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:20 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:20.960494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f6972a52-f905-45b3-9b0a-2a04cfc22614 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:20.961178 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f6972a52-f905-45b3-9b0a-2a04cfc22614 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:20.967815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f6972a52-f905-45b3-9b0a-2a04cfc22614 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:20.968301 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f6972a52-f905-45b3-9b0a-2a04cfc22614 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:20.969070 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f6972a52-f905-45b3-9b0a-2a04cfc22614 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:20.969511 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f6972a52-f905-45b3-9b0a-2a04cfc22614 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:20.999507 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:21.099825 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-f6972a52-f905-45b3-9b0a-2a04cfc22614 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lazy-loading 'services' on Instance uuid e7788e87-32b8-4250-bae6-b666d958ab97 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:34:21.183882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a9683c0f-8069-4837-ac95-6f3466974b5a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:21.184503 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a9683c0f-8069-4837-ac95-6f3466974b5a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:21.190427 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a9683c0f-8069-4837-ac95-6f3466974b5a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:21.190879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a9683c0f-8069-4837-ac95-6f3466974b5a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:21.191644 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a9683c0f-8069-4837-ac95-6f3466974b5a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:21.192080 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a9683c0f-8069-4837-ac95-6f3466974b5a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:21.217917 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f6972a52-f905-45b3-9b0a-2a04cfc22614 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/os-volume_attachments/2e943109-dba9-41ba-84fa-bf832c8cb832" status: 202 len: 0 microversion: 2.1 time: 0.261232 Jul 21 06:34:21.218733 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 304/622] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:34:20 2022] DELETE /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/os-volume_attachments/2e943109-dba9-41ba-84fa-bf832c8cb832 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:34:21.334645 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a9683c0f-8069-4837-ac95-6f3466974b5a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:21.344699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a9683c0f-8069-4837-ac95-6f3466974b5a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.165755 Jul 21 06:34:21.345276 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 319/623] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:21 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:22.363047 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-97051d11-6e96-4844-b9a6-8d7e2cffdb0a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:22.363750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-97051d11-6e96-4844-b9a6-8d7e2cffdb0a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:22.370495 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-97051d11-6e96-4844-b9a6-8d7e2cffdb0a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:22.370950 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-97051d11-6e96-4844-b9a6-8d7e2cffdb0a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:22.371712 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-97051d11-6e96-4844-b9a6-8d7e2cffdb0a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:22.372152 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-97051d11-6e96-4844-b9a6-8d7e2cffdb0a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:22.504405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-97051d11-6e96-4844-b9a6-8d7e2cffdb0a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:22.513466 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-97051d11-6e96-4844-b9a6-8d7e2cffdb0a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.155142 Jul 21 06:34:22.514046 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 305/624] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:22 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:23.391857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-16363740-7bf4-4747-866d-2c7d32b78d3f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:23.399213 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-16363740-7bf4-4747-866d-2c7d32b78d3f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:23.399660 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-16363740-7bf4-4747-866d-2c7d32b78d3f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:23.424610 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-16363740-7bf4-4747-866d-2c7d32b78d3f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Going to try to stop instance {{(pid=117906) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 06:34:23.449781 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:23.468731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-16363740-7bf4-4747-866d-2c7d32b78d3f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/action" status: 202 len: 0 microversion: 2.1 time: 0.080544 Jul 21 06:34:23.469659 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 320/625] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:34:23 2022] POST /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:34:23.478174 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-280b521e-63e7-4dda-b144-1f2c3fe6ff4b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:23.478900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-280b521e-63e7-4dda-b144-1f2c3fe6ff4b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:23.485331 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-280b521e-63e7-4dda-b144-1f2c3fe6ff4b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:23.485781 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-280b521e-63e7-4dda-b144-1f2c3fe6ff4b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:23.486588 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-280b521e-63e7-4dda-b144-1f2c3fe6ff4b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:23.487024 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-280b521e-63e7-4dda-b144-1f2c3fe6ff4b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:23.532032 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0a8f2f2c-3a21-4695-ade3-c1b7b4ec196a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:23.532728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0a8f2f2c-3a21-4695-ade3-c1b7b4ec196a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:23.539815 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0a8f2f2c-3a21-4695-ade3-c1b7b4ec196a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:23.540400 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0a8f2f2c-3a21-4695-ade3-c1b7b4ec196a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:23.541537 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0a8f2f2c-3a21-4695-ade3-c1b7b4ec196a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:23.541999 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0a8f2f2c-3a21-4695-ade3-c1b7b4ec196a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:23.678221 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-280b521e-63e7-4dda-b144-1f2c3fe6ff4b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:23.687964 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-280b521e-63e7-4dda-b144-1f2c3fe6ff4b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.214086 Jul 21 06:34:23.688973 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 306/626] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:23 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:23.709276 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0a8f2f2c-3a21-4695-ade3-c1b7b4ec196a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:23.717170 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0a8f2f2c-3a21-4695-ade3-c1b7b4ec196a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.189301 Jul 21 06:34:23.717728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 321/627] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:23 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:24.705907 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-73446f92-3de0-4c62-ad6f-a7cbec07c5ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:24.706738 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-73446f92-3de0-4c62-ad6f-a7cbec07c5ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:24.713574 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-73446f92-3de0-4c62-ad6f-a7cbec07c5ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:24.714048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-73446f92-3de0-4c62-ad6f-a7cbec07c5ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:24.714852 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-73446f92-3de0-4c62-ad6f-a7cbec07c5ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:24.715287 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-73446f92-3de0-4c62-ad6f-a7cbec07c5ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:24.735687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6b069c58-7b3c-48e9-bbe4-9524d461eab1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:24.736990 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6b069c58-7b3c-48e9-bbe4-9524d461eab1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:24.745539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b069c58-7b3c-48e9-bbe4-9524d461eab1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:24.746009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b069c58-7b3c-48e9-bbe4-9524d461eab1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:24.746781 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b069c58-7b3c-48e9-bbe4-9524d461eab1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:24.747217 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b069c58-7b3c-48e9-bbe4-9524d461eab1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:24.925132 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-73446f92-3de0-4c62-ad6f-a7cbec07c5ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:24.933289 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-73446f92-3de0-4c62-ad6f-a7cbec07c5ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.231915 Jul 21 06:34:24.933876 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 307/628] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:24 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:24.936901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6b069c58-7b3c-48e9-bbe4-9524d461eab1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:24.944839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6b069c58-7b3c-48e9-bbe4-9524d461eab1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.213038 Jul 21 06:34:24.945398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 322/629] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:24 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:25.951008 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ffe0b2d7-5f83-402b-852e-4c8f20d3fb34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:25.951636 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ffe0b2d7-5f83-402b-852e-4c8f20d3fb34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:25.958324 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ffe0b2d7-5f83-402b-852e-4c8f20d3fb34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:25.958777 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ffe0b2d7-5f83-402b-852e-4c8f20d3fb34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:25.959557 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ffe0b2d7-5f83-402b-852e-4c8f20d3fb34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:25.959996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ffe0b2d7-5f83-402b-852e-4c8f20d3fb34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:25.962455 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b9e06643-da31-46da-84ee-bd08bf8b996b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:25.962966 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b9e06643-da31-46da-84ee-bd08bf8b996b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:25.969216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b9e06643-da31-46da-84ee-bd08bf8b996b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:25.969664 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b9e06643-da31-46da-84ee-bd08bf8b996b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:25.970459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b9e06643-da31-46da-84ee-bd08bf8b996b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:25.970896 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b9e06643-da31-46da-84ee-bd08bf8b996b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:26.146514 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ffe0b2d7-5f83-402b-852e-4c8f20d3fb34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:26.157446 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ffe0b2d7-5f83-402b-852e-4c8f20d3fb34 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.210322 Jul 21 06:34:26.158062 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 308/630] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:25 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:26.169326 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b9e06643-da31-46da-84ee-bd08bf8b996b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:26.178458 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b9e06643-da31-46da-84ee-bd08bf8b996b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.220342 Jul 21 06:34:26.179039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 323/631] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:25 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:27.176437 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c8d10818-9fcc-4d16-99d0-729d5bde7028 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:27.176974 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c8d10818-9fcc-4d16-99d0-729d5bde7028 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:27.182889 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c8d10818-9fcc-4d16-99d0-729d5bde7028 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:27.183338 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c8d10818-9fcc-4d16-99d0-729d5bde7028 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:27.184218 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c8d10818-9fcc-4d16-99d0-729d5bde7028 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:27.184655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c8d10818-9fcc-4d16-99d0-729d5bde7028 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:27.196964 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-388cbfc0-e489-45fe-8ee2-4bb89533c899 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:27.197679 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-388cbfc0-e489-45fe-8ee2-4bb89533c899 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:27.204066 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-388cbfc0-e489-45fe-8ee2-4bb89533c899 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:27.204525 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-388cbfc0-e489-45fe-8ee2-4bb89533c899 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:27.205301 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-388cbfc0-e489-45fe-8ee2-4bb89533c899 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:27.205742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-388cbfc0-e489-45fe-8ee2-4bb89533c899 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:27.371749 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c8d10818-9fcc-4d16-99d0-729d5bde7028 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:27.379258 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c8d10818-9fcc-4d16-99d0-729d5bde7028 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.207932 Jul 21 06:34:27.379823 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 309/632] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:27 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:27.392961 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-388cbfc0-e489-45fe-8ee2-4bb89533c899 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:27.402287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-388cbfc0-e489-45fe-8ee2-4bb89533c899 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.209520 Jul 21 06:34:27.402847 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 324/633] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:27 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:28.397340 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b6b3ae75-18e1-46b8-8855-77c0f8a06598 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:28.398256 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b6b3ae75-18e1-46b8-8855-77c0f8a06598 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:28.405318 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b6b3ae75-18e1-46b8-8855-77c0f8a06598 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:28.405767 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b6b3ae75-18e1-46b8-8855-77c0f8a06598 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:28.406559 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b6b3ae75-18e1-46b8-8855-77c0f8a06598 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:28.406996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b6b3ae75-18e1-46b8-8855-77c0f8a06598 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:28.420046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-14d5d477-6e1c-4179-b5da-073e0f2b32d7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:28.420778 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-14d5d477-6e1c-4179-b5da-073e0f2b32d7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:28.427448 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-14d5d477-6e1c-4179-b5da-073e0f2b32d7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:28.427882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-14d5d477-6e1c-4179-b5da-073e0f2b32d7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:28.428653 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-14d5d477-6e1c-4179-b5da-073e0f2b32d7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:28.429094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-14d5d477-6e1c-4179-b5da-073e0f2b32d7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:28.611771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b6b3ae75-18e1-46b8-8855-77c0f8a06598 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:28.615651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-14d5d477-6e1c-4179-b5da-073e0f2b32d7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:28.620367 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b6b3ae75-18e1-46b8-8855-77c0f8a06598 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.226867 Jul 21 06:34:28.620941 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 310/634] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:28 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:28.624488 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-14d5d477-6e1c-4179-b5da-073e0f2b32d7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.208242 Jul 21 06:34:28.625055 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 325/635] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:28 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:29.638104 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b9b92657-cdcb-4445-ba0c-6085b72548b2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:29.638718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b9b92657-cdcb-4445-ba0c-6085b72548b2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:29.641903 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8d4102e2-378d-4d3a-878b-5e7031c19547 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:29.642558 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8d4102e2-378d-4d3a-878b-5e7031c19547 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:29.645104 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9b92657-cdcb-4445-ba0c-6085b72548b2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:29.645544 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9b92657-cdcb-4445-ba0c-6085b72548b2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:29.646329 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9b92657-cdcb-4445-ba0c-6085b72548b2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:29.646760 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b9b92657-cdcb-4445-ba0c-6085b72548b2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:29.649805 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d4102e2-378d-4d3a-878b-5e7031c19547 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:29.650277 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d4102e2-378d-4d3a-878b-5e7031c19547 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:29.651042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d4102e2-378d-4d3a-878b-5e7031c19547 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:29.651484 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d4102e2-378d-4d3a-878b-5e7031c19547 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:29.838368 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b9b92657-cdcb-4445-ba0c-6085b72548b2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:29.841775 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8d4102e2-378d-4d3a-878b-5e7031c19547 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:29.846610 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b9b92657-cdcb-4445-ba0c-6085b72548b2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.213072 Jul 21 06:34:29.847188 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 311/636] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:29 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:29.849688 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8d4102e2-378d-4d3a-878b-5e7031c19547 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.211541 Jul 21 06:34:29.850344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 326/637] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:29 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:30.863661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1d486385-8cfe-46f4-bee7-90eb21429379 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:30.864288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1d486385-8cfe-46f4-bee7-90eb21429379 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:30.865958 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-de19bc1d-6d72-470e-94e1-342b3656c793 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:30.866575 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-de19bc1d-6d72-470e-94e1-342b3656c793 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:30.873295 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1d486385-8cfe-46f4-bee7-90eb21429379 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:30.873478 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-de19bc1d-6d72-470e-94e1-342b3656c793 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:30.873732 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1d486385-8cfe-46f4-bee7-90eb21429379 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:30.873854 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-de19bc1d-6d72-470e-94e1-342b3656c793 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:30.874752 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1d486385-8cfe-46f4-bee7-90eb21429379 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:30.874871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-de19bc1d-6d72-470e-94e1-342b3656c793 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:30.875244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-de19bc1d-6d72-470e-94e1-342b3656c793 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:30.875452 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1d486385-8cfe-46f4-bee7-90eb21429379 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:31.294450 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-de19bc1d-6d72-470e-94e1-342b3656c793 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:31.297305 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1d486385-8cfe-46f4-bee7-90eb21429379 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:31.302547 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-de19bc1d-6d72-470e-94e1-342b3656c793 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1735 microversion: 2.1 time: 0.440322 Jul 21 06:34:31.303126 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 327/638] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:30 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1735 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:31.304754 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1d486385-8cfe-46f4-bee7-90eb21429379 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.444971 Jul 21 06:34:31.306052 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 312/639] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:30 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:32.173505 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-984851bb-6d7a-4f6f-a51e-e2750342bd55 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "941c832f-a699-4464-8ac3-b00fdec54941", "device": "/dev/sdb"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:32.175142 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-984851bb-6d7a-4f6f-a51e-e2750342bd55 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:32.182210 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-984851bb-6d7a-4f6f-a51e-e2750342bd55 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.182658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-984851bb-6d7a-4f6f-a51e-e2750342bd55 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.183456 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-984851bb-6d7a-4f6f-a51e-e2750342bd55 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.183892 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-984851bb-6d7a-4f6f-a51e-e2750342bd55 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.320655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-aafff4d1-086e-4e2b-b414-1cb1d5d8789a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:32.321426 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-aafff4d1-086e-4e2b-b414-1cb1d5d8789a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:32.327752 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aafff4d1-086e-4e2b-b414-1cb1d5d8789a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.328202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aafff4d1-086e-4e2b-b414-1cb1d5d8789a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.328977 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aafff4d1-086e-4e2b-b414-1cb1d5d8789a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.329412 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-aafff4d1-086e-4e2b-b414-1cb1d5d8789a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.443632 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-984851bb-6d7a-4f6f-a51e-e2750342bd55 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "POST /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273938 Jul 21 06:34:32.444249 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 328/640] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:34:32 2022] POST /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:32.449413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-036a9823-4bb7-4ea2-bc55-3345fedc8402 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:32.450145 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-036a9823-4bb7-4ea2-bc55-3345fedc8402 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:32.456673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-036a9823-4bb7-4ea2-bc55-3345fedc8402 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.457196 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-036a9823-4bb7-4ea2-bc55-3345fedc8402 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.457898 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-036a9823-4bb7-4ea2-bc55-3345fedc8402 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.458366 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-036a9823-4bb7-4ea2-bc55-3345fedc8402 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.467155 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-aafff4d1-086e-4e2b-b414-1cb1d5d8789a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:32.476784 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-aafff4d1-086e-4e2b-b414-1cb1d5d8789a tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1715 microversion: 2.1 time: 0.160009 Jul 21 06:34:32.478127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 313/641] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:32 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:32.590289 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-75fd4fef-a7ec-4c30-b43e-1f772dba1d4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:32.591487 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-75fd4fef-a7ec-4c30-b43e-1f772dba1d4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:32.596940 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75fd4fef-a7ec-4c30-b43e-1f772dba1d4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.597420 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75fd4fef-a7ec-4c30-b43e-1f772dba1d4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.598213 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75fd4fef-a7ec-4c30-b43e-1f772dba1d4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.598648 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75fd4fef-a7ec-4c30-b43e-1f772dba1d4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.612858 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-036a9823-4bb7-4ea2-bc55-3345fedc8402 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:32.621624 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-036a9823-4bb7-4ea2-bc55-3345fedc8402 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.176240 Jul 21 06:34:32.622376 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 329/642] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:32 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:32.682296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-75fd4fef-a7ec-4c30-b43e-1f772dba1d4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] HTTP exception thrown: Cannot 'detach_volume' instance 6d312821-22fc-4f7a-9a04-88f677a66511 while it is in vm_state rescued Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-75fd4fef-a7ec-4c30-b43e-1f772dba1d4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Request method failure captured: Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: DELETE /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments/09f931a3-5e05-40f8-8ddc-108c279ad49d HTTP/1.1 Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PJ-FFa9px1qCFnQ_sVPIFJANLwiQsrfzGqBK9nRcF_7iLo1GNYjYZxw0dARm7jCwmHAsciC1YM2eh222mYLJQw7VTxzlGyzWumMt_LTTamWiA7oArJUmVZuWCK9D7wzeppFw1Lud6bU_EHLtCwlZMUAtguGU1smt37yBYtT3R5G4sQ Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: 9cd8a1a642a24b519aefdde9ed336536 Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:34:32.684272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9cd8a1a642a24b519aefdde9ed336536"}]}] Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: 9cd8a1a642a24b519aefdde9ed336536 Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-ServerRescueNegativeTestJSON-1302720953-project Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 774dd66c674a4955a439afd30354efab Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1302720953-project Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:34:32.685796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Cannot 'detach_volume' instance 6d312821-22fc-4f7a-9a04-88f677a66511 while it is in vm_state rescued Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'server_id': '6d312821-22fc-4f7a-9a04-88f677a66511', 'id': '09f931a3-5e05-40f8-8ddc-108c279ad49d'} Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d312821-22fc-4f7a-9a04-88f677a66511 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:34:32.689878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6d312821-22fc-4f7a-9a04-88f677a66511 while it is in vm_state rescued Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6d312821-22fc-4f7a-9a04-88f677a66511 while it is in vm_state rescued Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:34:32.691444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-75fd4fef-a7ec-4c30-b43e-1f772dba1d4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Returning 409 to user: Cannot 'detach_volume' instance 6d312821-22fc-4f7a-9a04-88f677a66511 while it is in vm_state rescued {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:34:32.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-75fd4fef-a7ec-4c30-b43e-1f772dba1d4c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments/09f931a3-5e05-40f8-8ddc-108c279ad49d" status: 409 len: 152 microversion: 2.1 time: 0.100769 Jul 21 06:34:32.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 314/643] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:34:32 2022] DELETE /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments/09f931a3-5e05-40f8-8ddc-108c279ad49d => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 21 06:34:32.694834 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b1dfa23c-23b4-468f-9bbc-4d2c2db5e7dc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:32.695408 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b1dfa23c-23b4-468f-9bbc-4d2c2db5e7dc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:32.701962 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1dfa23c-23b4-468f-9bbc-4d2c2db5e7dc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.702417 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1dfa23c-23b4-468f-9bbc-4d2c2db5e7dc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.703177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1dfa23c-23b4-468f-9bbc-4d2c2db5e7dc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.703613 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1dfa23c-23b4-468f-9bbc-4d2c2db5e7dc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.768146 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b1dfa23c-23b4-468f-9bbc-4d2c2db5e7dc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "POST /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/action" status: 202 len: 0 microversion: 2.1 time: 0.076929 Jul 21 06:34:32.768782 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 330/644] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:34:32 2022] POST /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 06:34:32.777853 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d3beebc6-eee1-4a01-840c-4dd1bde620c9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:32.779201 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d3beebc6-eee1-4a01-840c-4dd1bde620c9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:32.785409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d3beebc6-eee1-4a01-840c-4dd1bde620c9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.785889 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d3beebc6-eee1-4a01-840c-4dd1bde620c9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:32.786861 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d3beebc6-eee1-4a01-840c-4dd1bde620c9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:32.787515 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d3beebc6-eee1-4a01-840c-4dd1bde620c9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:33.014471 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d3beebc6-eee1-4a01-840c-4dd1bde620c9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:33.022255 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d3beebc6-eee1-4a01-840c-4dd1bde620c9 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1723 microversion: 2.1 time: 0.248829 Jul 21 06:34:33.023091 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 315/645] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:32 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:33.640406 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1dc366a2-6b51-43fb-8c05-0232500102ed tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:33.641052 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1dc366a2-6b51-43fb-8c05-0232500102ed tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:33.647308 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1dc366a2-6b51-43fb-8c05-0232500102ed tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:33.648028 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1dc366a2-6b51-43fb-8c05-0232500102ed tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:33.648835 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1dc366a2-6b51-43fb-8c05-0232500102ed tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:33.649394 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1dc366a2-6b51-43fb-8c05-0232500102ed tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:33.781469 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1dc366a2-6b51-43fb-8c05-0232500102ed tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:33.788856 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1dc366a2-6b51-43fb-8c05-0232500102ed tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.153245 Jul 21 06:34:33.789452 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 331/646] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:33 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:34.040093 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-46d262d7-0d8e-4998-949c-afdf6c8e470c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:34.040631 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-46d262d7-0d8e-4998-949c-afdf6c8e470c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:34.047170 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-46d262d7-0d8e-4998-949c-afdf6c8e470c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:34.047623 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-46d262d7-0d8e-4998-949c-afdf6c8e470c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:34.048397 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-46d262d7-0d8e-4998-949c-afdf6c8e470c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:34.048833 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-46d262d7-0d8e-4998-949c-afdf6c8e470c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:34.180645 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-46d262d7-0d8e-4998-949c-afdf6c8e470c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:34.188616 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-46d262d7-0d8e-4998-949c-afdf6c8e470c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1723 microversion: 2.1 time: 0.152432 Jul 21 06:34:34.189213 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 316/647] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:34 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:34.806884 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-85cb1813-d028-48b6-b871-38d01cdd2159 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:34.807496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-85cb1813-d028-48b6-b871-38d01cdd2159 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:34.819960 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-85cb1813-d028-48b6-b871-38d01cdd2159 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:34.820414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-85cb1813-d028-48b6-b871-38d01cdd2159 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:34.821659 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-85cb1813-d028-48b6-b871-38d01cdd2159 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:34.822128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-85cb1813-d028-48b6-b871-38d01cdd2159 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:34.952047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-85cb1813-d028-48b6-b871-38d01cdd2159 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:34.959434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-85cb1813-d028-48b6-b871-38d01cdd2159 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.157166 Jul 21 06:34:34.959996 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 332/648] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:34 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:35.205511 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9c3be170-b2d0-411f-835b-4e17914c1687 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:35.206040 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9c3be170-b2d0-411f-835b-4e17914c1687 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:35.208405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=52 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:35.214946 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c3be170-b2d0-411f-835b-4e17914c1687 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:35.215391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c3be170-b2d0-411f-835b-4e17914c1687 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:35.216151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c3be170-b2d0-411f-835b-4e17914c1687 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:35.216585 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c3be170-b2d0-411f-835b-4e17914c1687 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:35.345279 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9c3be170-b2d0-411f-835b-4e17914c1687 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:35.353575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9c3be170-b2d0-411f-835b-4e17914c1687 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1723 microversion: 2.1 time: 0.152036 Jul 21 06:34:35.354178 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 317/649] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:35 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:35.976789 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6b44fe5d-ee27-4dcb-a0a5-b5fc467783ee tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:35.977395 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6b44fe5d-ee27-4dcb-a0a5-b5fc467783ee tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:35.983985 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b44fe5d-ee27-4dcb-a0a5-b5fc467783ee tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:35.984426 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b44fe5d-ee27-4dcb-a0a5-b5fc467783ee tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:35.985179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b44fe5d-ee27-4dcb-a0a5-b5fc467783ee tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:35.985659 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b44fe5d-ee27-4dcb-a0a5-b5fc467783ee tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:36.120276 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6b44fe5d-ee27-4dcb-a0a5-b5fc467783ee tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:36.127955 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6b44fe5d-ee27-4dcb-a0a5-b5fc467783ee tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.154964 Jul 21 06:34:36.128519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 333/650] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:35 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:36.371531 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-519f3a39-2d09-41bd-9382-0a88ffa09951 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:36.372047 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-519f3a39-2d09-41bd-9382-0a88ffa09951 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:36.378712 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-519f3a39-2d09-41bd-9382-0a88ffa09951 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:36.379157 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-519f3a39-2d09-41bd-9382-0a88ffa09951 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:36.379919 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-519f3a39-2d09-41bd-9382-0a88ffa09951 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:36.380350 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-519f3a39-2d09-41bd-9382-0a88ffa09951 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:36.507996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-519f3a39-2d09-41bd-9382-0a88ffa09951 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:36.516844 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-519f3a39-2d09-41bd-9382-0a88ffa09951 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1723 microversion: 2.1 time: 0.149846 Jul 21 06:34:36.517420 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 318/651] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:36 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:37.144747 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9b5fab09-c7c0-419f-b5b5-5ac85a3d24e8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:37.145504 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9b5fab09-c7c0-419f-b5b5-5ac85a3d24e8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:37.153536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b5fab09-c7c0-419f-b5b5-5ac85a3d24e8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:37.154010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b5fab09-c7c0-419f-b5b5-5ac85a3d24e8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:37.154791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b5fab09-c7c0-419f-b5b5-5ac85a3d24e8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:37.155239 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b5fab09-c7c0-419f-b5b5-5ac85a3d24e8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:37.287909 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9b5fab09-c7c0-419f-b5b5-5ac85a3d24e8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:37.292960 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:37.301625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9b5fab09-c7c0-419f-b5b5-5ac85a3d24e8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.160509 Jul 21 06:34:37.302415 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 334/652] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:37 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:37.536484 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b467bb57-8567-462a-ac54-a151cdf6570b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:37.537096 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b467bb57-8567-462a-ac54-a151cdf6570b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:37.544309 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b467bb57-8567-462a-ac54-a151cdf6570b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:37.544758 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b467bb57-8567-462a-ac54-a151cdf6570b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:37.545510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b467bb57-8567-462a-ac54-a151cdf6570b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:37.545957 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b467bb57-8567-462a-ac54-a151cdf6570b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:37.673903 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b467bb57-8567-462a-ac54-a151cdf6570b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:37.682582 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b467bb57-8567-462a-ac54-a151cdf6570b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1729 microversion: 2.1 time: 0.149865 Jul 21 06:34:37.683149 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 319/653] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:37 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:37.698933 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-038084f8-6273-4a4b-b972-a437981981d6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:37.699421 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-038084f8-6273-4a4b-b972-a437981981d6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:37.706403 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-038084f8-6273-4a4b-b972-a437981981d6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:37.706850 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-038084f8-6273-4a4b-b972-a437981981d6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:37.707602 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-038084f8-6273-4a4b-b972-a437981981d6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:37.708033 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-038084f8-6273-4a4b-b972-a437981981d6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:37.785799 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-038084f8-6273-4a4b-b972-a437981981d6 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090679 Jul 21 06:34:37.786426 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 335/654] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 06:34:37 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:38.318992 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-34a59e94-1908-46c1-8985-fbab1b5921eb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:38.319530 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-34a59e94-1908-46c1-8985-fbab1b5921eb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:38.326338 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-34a59e94-1908-46c1-8985-fbab1b5921eb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:38.326785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-34a59e94-1908-46c1-8985-fbab1b5921eb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:38.327543 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-34a59e94-1908-46c1-8985-fbab1b5921eb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:38.327980 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-34a59e94-1908-46c1-8985-fbab1b5921eb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:38.331917 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:38.564663 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-34a59e94-1908-46c1-8985-fbab1b5921eb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:38.573018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-34a59e94-1908-46c1-8985-fbab1b5921eb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.257855 Jul 21 06:34:38.573505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 320/655] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:38 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:38.745369 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-ff562c98-d0b3-4e9f-aa90-6aa51b47065e req-8b861db9-54f1-4d09-90d5-35cb06164290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d312821-22fc-4f7a-9a04-88f677a66511", "tag": "f6cc1e71-5824-4e10-98c9-72b30b663270"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:38.757933 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-ff562c98-d0b3-4e9f-aa90-6aa51b47065e req-8b861db9-54f1-4d09-90d5-35cb06164290 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:38.758405 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-ff562c98-d0b3-4e9f-aa90-6aa51b47065e req-8b861db9-54f1-4d09-90d5-35cb06164290 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:38.769630 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-ff562c98-d0b3-4e9f-aa90-6aa51b47065e req-8b861db9-54f1-4d09-90d5-35cb06164290 service nova] Creating event network-changed:f6cc1e71-5824-4e10-98c9-72b30b663270 for instance 6d312821-22fc-4f7a-9a04-88f677a66511 on hv-cinder-85031 Jul 21 06:34:38.775791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-ff562c98-d0b3-4e9f-aa90-6aa51b47065e req-8b861db9-54f1-4d09-90d5-35cb06164290 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038250 Jul 21 06:34:38.776395 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 336/656] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:39.590304 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-09ab5a78-64a6-4217-9a85-397283c9c50f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:39.590930 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-09ab5a78-64a6-4217-9a85-397283c9c50f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:39.600033 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-09ab5a78-64a6-4217-9a85-397283c9c50f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:39.601776 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-09ab5a78-64a6-4217-9a85-397283c9c50f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:39.603646 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-09ab5a78-64a6-4217-9a85-397283c9c50f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:39.604108 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-09ab5a78-64a6-4217-9a85-397283c9c50f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:39.761476 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-09ab5a78-64a6-4217-9a85-397283c9c50f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:39.768970 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-09ab5a78-64a6-4217-9a85-397283c9c50f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.182746 Jul 21 06:34:39.769550 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 321/657] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:39 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:40.787618 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-76482b7e-0889-40f8-b1da-ed849c50a0ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:40.788350 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-76482b7e-0889-40f8-b1da-ed849c50a0ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:40.790109 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-94f232e1-36d7-4ac5-9db6-1af1a37d2e04 req-88e303d4-f120-4f2b-bbda-29144abbb975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d312821-22fc-4f7a-9a04-88f677a66511", "tag": "f6cc1e71-5824-4e10-98c9-72b30b663270"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:40.795387 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76482b7e-0889-40f8-b1da-ed849c50a0ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:40.795640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76482b7e-0889-40f8-b1da-ed849c50a0ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:40.796398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76482b7e-0889-40f8-b1da-ed849c50a0ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:40.796832 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76482b7e-0889-40f8-b1da-ed849c50a0ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:40.798836 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-94f232e1-36d7-4ac5-9db6-1af1a37d2e04 req-88e303d4-f120-4f2b-bbda-29144abbb975 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:40.799283 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-94f232e1-36d7-4ac5-9db6-1af1a37d2e04 req-88e303d4-f120-4f2b-bbda-29144abbb975 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:40.810745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-94f232e1-36d7-4ac5-9db6-1af1a37d2e04 req-88e303d4-f120-4f2b-bbda-29144abbb975 service nova] Creating event network-changed:f6cc1e71-5824-4e10-98c9-72b30b663270 for instance 6d312821-22fc-4f7a-9a04-88f677a66511 on hv-cinder-85031 Jul 21 06:34:40.815736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-94f232e1-36d7-4ac5-9db6-1af1a37d2e04 req-88e303d4-f120-4f2b-bbda-29144abbb975 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029376 Jul 21 06:34:40.816935 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 322/658] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:34:41.153985 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-76482b7e-0889-40f8-b1da-ed849c50a0ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:41.161397 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-76482b7e-0889-40f8-b1da-ed849c50a0ab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.378472 Jul 21 06:34:41.161969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 337/659] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:40 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:42.179161 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ed775418-a34e-448c-aec1-0f96471fb6e3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:42.179866 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ed775418-a34e-448c-aec1-0f96471fb6e3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:42.186275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed775418-a34e-448c-aec1-0f96471fb6e3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:42.186741 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed775418-a34e-448c-aec1-0f96471fb6e3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:42.187507 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed775418-a34e-448c-aec1-0f96471fb6e3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:42.187948 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed775418-a34e-448c-aec1-0f96471fb6e3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:42.314163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ed775418-a34e-448c-aec1-0f96471fb6e3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:42.321610 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ed775418-a34e-448c-aec1-0f96471fb6e3 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1676 microversion: 2.1 time: 0.147011 Jul 21 06:34:42.322201 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 323/660] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:42 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:43.339747 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b269508c-35c8-46c4-b6cc-0f4ca8c6a6d8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:43.340410 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b269508c-35c8-46c4-b6cc-0f4ca8c6a6d8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:43.347466 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b269508c-35c8-46c4-b6cc-0f4ca8c6a6d8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:43.347917 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b269508c-35c8-46c4-b6cc-0f4ca8c6a6d8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:43.348686 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b269508c-35c8-46c4-b6cc-0f4ca8c6a6d8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:43.349135 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b269508c-35c8-46c4-b6cc-0f4ca8c6a6d8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:43.548879 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b269508c-35c8-46c4-b6cc-0f4ca8c6a6d8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:43.556669 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b269508c-35c8-46c4-b6cc-0f4ca8c6a6d8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1653 microversion: 2.1 time: 0.221781 Jul 21 06:34:43.557934 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 338/661] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:43 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1653 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:43.573604 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d7a34568-a769-454f-a7af-ec4a9773012c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:43.580395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d7a34568-a769-454f-a7af-ec4a9773012c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:43.580926 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d7a34568-a769-454f-a7af-ec4a9773012c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:43.602723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d7a34568-a769-454f-a7af-ec4a9773012c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Going to try to start instance {{(pid=117905) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 06:34:43.644820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d7a34568-a769-454f-a7af-ec4a9773012c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/action" status: 202 len: 0 microversion: 2.1 time: 0.074983 Jul 21 06:34:43.645426 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 324/662] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:34:43 2022] POST /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:34:43.654717 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-40e70da3-28be-417e-9a86-a88a45fd2a7d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:43.655435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-40e70da3-28be-417e-9a86-a88a45fd2a7d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:43.661512 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-40e70da3-28be-417e-9a86-a88a45fd2a7d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:43.662021 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-40e70da3-28be-417e-9a86-a88a45fd2a7d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:43.662786 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-40e70da3-28be-417e-9a86-a88a45fd2a7d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:43.663208 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-40e70da3-28be-417e-9a86-a88a45fd2a7d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:43.861871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-40e70da3-28be-417e-9a86-a88a45fd2a7d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:43.870222 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-40e70da3-28be-417e-9a86-a88a45fd2a7d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1662 microversion: 2.1 time: 0.219429 Jul 21 06:34:43.870825 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 339/663] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:43 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1662 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:44.268417 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4ec816df-cc1c-4b34-9ab1-0b0c0a3066b8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:44.269460 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4ec816df-cc1c-4b34-9ab1-0b0c0a3066b8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:44.278438 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ec816df-cc1c-4b34-9ab1-0b0c0a3066b8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:44.279237 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ec816df-cc1c-4b34-9ab1-0b0c0a3066b8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:44.280336 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ec816df-cc1c-4b34-9ab1-0b0c0a3066b8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:44.281016 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ec816df-cc1c-4b34-9ab1-0b0c0a3066b8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:44.308155 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4ec816df-cc1c-4b34-9ab1-0b0c0a3066b8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595/ips" status: 200 len: 150 microversion: 2.1 time: 0.044212 Jul 21 06:34:44.314654 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 325/664] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 06:34:44 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:44.320532 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0ec85410-08ab-4e91-8ca7-5290f139ac74 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54a2284c-0453-4c14-852c-c9fb62554395"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:44.321607 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0ec85410-08ab-4e91-8ca7-5290f139ac74 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:44.328026 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ec85410-08ab-4e91-8ca7-5290f139ac74 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:44.328328 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ec85410-08ab-4e91-8ca7-5290f139ac74 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:44.329094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ec85410-08ab-4e91-8ca7-5290f139ac74 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:44.329549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0ec85410-08ab-4e91-8ca7-5290f139ac74 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:44.419074 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-0ec85410-08ab-4e91-8ca7-5290f139ac74 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Invalid volume: volume 54a2284c-0453-4c14-852c-c9fb62554395 is already attached to instances: 43f81355-5e49-4559-b29c-b6faefe880b7 Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0ec85410-08ab-4e91-8ca7-5290f139ac74 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: POST /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595/os-volume_attachments HTTP/1.1 Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 74 Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:34:44.421093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {"volumeAttachment": {"volumeId": "54a2284c-0453-4c14-852c-c9fb62554395"}} Jul 21 06:34:44.422485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Invalid volume: volume 54a2284c-0453-4c14-852c-c9fb62554395 is already attached to instances: 43f81355-5e49-4559-b29c-b6faefe880b7 Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'server_id': '3c3a3de3-c6af-4f50-b999-d47265b43595', 'body': {'volumeAttachment': {'volumeId': '54a2284c-0453-4c14-852c-c9fb62554395'}}} Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 54a2284c-0453-4c14-852c-c9fb62554395 is already attached to instances: 43f81355-5e49-4559-b29c-b6faefe880b7 Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:34:44.423411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 54a2284c-0453-4c14-852c-c9fb62554395 is already attached to instances: 43f81355-5e49-4559-b29c-b6faefe880b7 Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:34:44.424876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:34:44.426499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:34:44.426499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:34:44.426499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:34:44.426499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 54a2284c-0453-4c14-852c-c9fb62554395 is already attached to instances: 43f81355-5e49-4559-b29c-b6faefe880b7 Jul 21 06:34:44.426499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:34:44.426499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0ec85410-08ab-4e91-8ca7-5290f139ac74 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 400 to user: Invalid volume: volume 54a2284c-0453-4c14-852c-c9fb62554395 is already attached to instances: 43f81355-5e49-4559-b29c-b6faefe880b7 {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:34:44.426499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0ec85410-08ab-4e91-8ca7-5290f139ac74 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106656 Jul 21 06:34:44.426499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 340/665] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:34:44 2022] POST /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 06:34:44.433716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ff18974f-54f4-4e93-90e0-8cf9f71fc3b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:44.434265 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ff18974f-54f4-4e93-90e0-8cf9f71fc3b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:44.440243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ff18974f-54f4-4e93-90e0-8cf9f71fc3b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:44.440700 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ff18974f-54f4-4e93-90e0-8cf9f71fc3b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:44.441467 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ff18974f-54f4-4e93-90e0-8cf9f71fc3b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:44.441913 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ff18974f-54f4-4e93-90e0-8cf9f71fc3b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:44.468647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ff18974f-54f4-4e93-90e0-8cf9f71fc3b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:34:44.544314 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ff18974f-54f4-4e93-90e0-8cf9f71fc3b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 204 len: 0 microversion: 2.1 time: 0.114131 Jul 21 06:34:44.545291 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 326/666] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:34:44 2022] DELETE /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:34:44.553072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0e15df00-9a5b-4d2a-a50d-4ff1369ac0fa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:44.553718 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0e15df00-9a5b-4d2a-a50d-4ff1369ac0fa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:44.560777 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0e15df00-9a5b-4d2a-a50d-4ff1369ac0fa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:44.561222 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0e15df00-9a5b-4d2a-a50d-4ff1369ac0fa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:44.562034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0e15df00-9a5b-4d2a-a50d-4ff1369ac0fa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:44.562481 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0e15df00-9a5b-4d2a-a50d-4ff1369ac0fa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:44.696477 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0e15df00-9a5b-4d2a-a50d-4ff1369ac0fa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:44.704102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0e15df00-9a5b-4d2a-a50d-4ff1369ac0fa tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1682 microversion: 2.1 time: 0.154847 Jul 21 06:34:44.704664 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 341/667] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:44 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:44.889438 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-143e712b-8b69-48c0-898a-e0365509cb61 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:44.890173 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-143e712b-8b69-48c0-898a-e0365509cb61 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:44.896943 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-143e712b-8b69-48c0-898a-e0365509cb61 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:44.897337 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-143e712b-8b69-48c0-898a-e0365509cb61 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:44.898395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-143e712b-8b69-48c0-898a-e0365509cb61 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:44.898834 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-143e712b-8b69-48c0-898a-e0365509cb61 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:45.026656 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-143e712b-8b69-48c0-898a-e0365509cb61 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:45.034038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-143e712b-8b69-48c0-898a-e0365509cb61 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1662 microversion: 2.1 time: 0.149411 Jul 21 06:34:45.034600 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 327/668] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:44 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:45.721347 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d21e109d-ed65-42bc-b383-e05ba735d3ff tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:45.721989 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d21e109d-ed65-42bc-b383-e05ba735d3ff tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:45.729096 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d21e109d-ed65-42bc-b383-e05ba735d3ff tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:45.729608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d21e109d-ed65-42bc-b383-e05ba735d3ff tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:45.730426 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d21e109d-ed65-42bc-b383-e05ba735d3ff tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:45.730888 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d21e109d-ed65-42bc-b383-e05ba735d3ff tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:45.859275 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d21e109d-ed65-42bc-b383-e05ba735d3ff tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:45.866833 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d21e109d-ed65-42bc-b383-e05ba735d3ff tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1682 microversion: 2.1 time: 0.149382 Jul 21 06:34:45.867395 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 342/669] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:45 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:46.051765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-02564362-0fc5-4ccf-8cc6-8864f0f5785e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:46.052343 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-02564362-0fc5-4ccf-8cc6-8864f0f5785e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:46.059350 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-02564362-0fc5-4ccf-8cc6-8864f0f5785e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:46.059805 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-02564362-0fc5-4ccf-8cc6-8864f0f5785e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:46.060575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-02564362-0fc5-4ccf-8cc6-8864f0f5785e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:46.061012 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-02564362-0fc5-4ccf-8cc6-8864f0f5785e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:46.193433 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-02564362-0fc5-4ccf-8cc6-8864f0f5785e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:46.200832 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-02564362-0fc5-4ccf-8cc6-8864f0f5785e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1662 microversion: 2.1 time: 0.153004 Jul 21 06:34:46.201401 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 328/670] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:46 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:46.887903 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e3dadfeb-fc91-429b-a789-7b9acadd7918 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:46.888516 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e3dadfeb-fc91-429b-a789-7b9acadd7918 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:46.896773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e3dadfeb-fc91-429b-a789-7b9acadd7918 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:46.897287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e3dadfeb-fc91-429b-a789-7b9acadd7918 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:46.898498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e3dadfeb-fc91-429b-a789-7b9acadd7918 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:46.898932 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e3dadfeb-fc91-429b-a789-7b9acadd7918 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:47.026557 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e3dadfeb-fc91-429b-a789-7b9acadd7918 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:47.033872 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e3dadfeb-fc91-429b-a789-7b9acadd7918 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1682 microversion: 2.1 time: 0.150049 Jul 21 06:34:47.034465 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 343/671] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:46 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:47.218352 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b96405aa-94c8-41b4-824d-4926aa875453 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:47.218960 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b96405aa-94c8-41b4-824d-4926aa875453 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:47.225299 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b96405aa-94c8-41b4-824d-4926aa875453 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:47.225751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b96405aa-94c8-41b4-824d-4926aa875453 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:47.226550 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b96405aa-94c8-41b4-824d-4926aa875453 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:47.226987 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b96405aa-94c8-41b4-824d-4926aa875453 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:47.358913 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b96405aa-94c8-41b4-824d-4926aa875453 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:47.366204 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b96405aa-94c8-41b4-824d-4926aa875453 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1662 microversion: 2.1 time: 0.151661 Jul 21 06:34:47.366767 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 329/672] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:47 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:48.051638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-efb2fb88-195a-47c4-8ca6-16f017b95ab5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:48.052297 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-efb2fb88-195a-47c4-8ca6-16f017b95ab5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:48.054725 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=54 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:48.060697 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-efb2fb88-195a-47c4-8ca6-16f017b95ab5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:48.061149 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-efb2fb88-195a-47c4-8ca6-16f017b95ab5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:48.061924 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-efb2fb88-195a-47c4-8ca6-16f017b95ab5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:48.062388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-efb2fb88-195a-47c4-8ca6-16f017b95ab5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:48.189717 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-efb2fb88-195a-47c4-8ca6-16f017b95ab5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:48.197808 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-efb2fb88-195a-47c4-8ca6-16f017b95ab5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1682 microversion: 2.1 time: 0.149492 Jul 21 06:34:48.198473 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 344/673] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:48 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:48.384294 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-455c8a05-f809-4093-afdc-c239eb97c441 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:48.385114 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-455c8a05-f809-4093-afdc-c239eb97c441 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:48.392084 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-455c8a05-f809-4093-afdc-c239eb97c441 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:48.392479 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-455c8a05-f809-4093-afdc-c239eb97c441 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:48.393251 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-455c8a05-f809-4093-afdc-c239eb97c441 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:48.393691 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-455c8a05-f809-4093-afdc-c239eb97c441 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:48.522349 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-455c8a05-f809-4093-afdc-c239eb97c441 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:48.532197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-455c8a05-f809-4093-afdc-c239eb97c441 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1666 microversion: 2.1 time: 0.151657 Jul 21 06:34:48.532783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 330/674] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:48 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:49.215567 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1bc342f6-9dab-475d-8533-2109f9729b1f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:49.216118 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1bc342f6-9dab-475d-8533-2109f9729b1f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:49.222616 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1bc342f6-9dab-475d-8533-2109f9729b1f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:49.223068 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1bc342f6-9dab-475d-8533-2109f9729b1f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:49.223828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1bc342f6-9dab-475d-8533-2109f9729b1f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:49.224268 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1bc342f6-9dab-475d-8533-2109f9729b1f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:49.365158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1bc342f6-9dab-475d-8533-2109f9729b1f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:49.373833 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1bc342f6-9dab-475d-8533-2109f9729b1f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1682 microversion: 2.1 time: 0.162683 Jul 21 06:34:49.374544 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 345/675] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:49 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:49.626783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-dceada72-b306-4878-90c5-007c7e3d4bca req-8da54f62-aac3-49be-8ba6-55a7d942ee0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c3a3de3-c6af-4f50-b999-d47265b43595", "name": "network-vif-deleted", "tag": "ec590c24-0627-4416-8dda-da4d559e2b05"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:49.638025 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-dceada72-b306-4878-90c5-007c7e3d4bca req-8da54f62-aac3-49be-8ba6-55a7d942ee0d service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:49.638637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-dceada72-b306-4878-90c5-007c7e3d4bca req-8da54f62-aac3-49be-8ba6-55a7d942ee0d service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:49.650972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-dceada72-b306-4878-90c5-007c7e3d4bca req-8da54f62-aac3-49be-8ba6-55a7d942ee0d service nova] Creating event network-vif-deleted:ec590c24-0627-4416-8dda-da4d559e2b05 for instance 3c3a3de3-c6af-4f50-b999-d47265b43595 on hv-cinder-85031 Jul 21 06:34:49.656830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-dceada72-b306-4878-90c5-007c7e3d4bca req-8da54f62-aac3-49be-8ba6-55a7d942ee0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033515 Jul 21 06:34:49.657594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 331/676] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:50.392861 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1de3abb3-508b-4045-b5be-95d6790f93c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:50.393598 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1de3abb3-508b-4045-b5be-95d6790f93c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:50.401638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1de3abb3-508b-4045-b5be-95d6790f93c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:50.402434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1de3abb3-508b-4045-b5be-95d6790f93c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:50.403320 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1de3abb3-508b-4045-b5be-95d6790f93c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:50.403815 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1de3abb3-508b-4045-b5be-95d6790f93c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:50.469682 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1de3abb3-508b-4045-b5be-95d6790f93c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:50.477089 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1de3abb3-508b-4045-b5be-95d6790f93c9 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1614 microversion: 2.1 time: 0.089047 Jul 21 06:34:50.478072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 346/677] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:50 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:51.494870 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5dd43ef9-ae75-4755-8f05-0ab9e778c055 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:51.495465 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5dd43ef9-ae75-4755-8f05-0ab9e778c055 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:51.502323 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5dd43ef9-ae75-4755-8f05-0ab9e778c055 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:51.502768 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5dd43ef9-ae75-4755-8f05-0ab9e778c055 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:51.503520 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5dd43ef9-ae75-4755-8f05-0ab9e778c055 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:51.503953 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5dd43ef9-ae75-4755-8f05-0ab9e778c055 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:51.568310 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5dd43ef9-ae75-4755-8f05-0ab9e778c055 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:51.576594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5dd43ef9-ae75-4755-8f05-0ab9e778c055 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 200 len: 1326 microversion: 2.1 time: 0.086142 Jul 21 06:34:51.577183 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 332/678] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:51 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:52.594081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f4ba0e8e-fe7d-44bb-9289-106dfbd22f78 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:52.594695 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f4ba0e8e-fe7d-44bb-9289-106dfbd22f78 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:52.601148 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4ba0e8e-fe7d-44bb-9289-106dfbd22f78 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:52.601594 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4ba0e8e-fe7d-44bb-9289-106dfbd22f78 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:52.602395 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4ba0e8e-fe7d-44bb-9289-106dfbd22f78 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:52.602830 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4ba0e8e-fe7d-44bb-9289-106dfbd22f78 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:52.616077 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-f4ba0e8e-fe7d-44bb-9289-106dfbd22f78 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f4ba0e8e-fe7d-44bb-9289-106dfbd22f78 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 HTTP/1.1 Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:34:52.617571 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:34:52.619648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '3c3a3de3-c6af-4f50-b999-d47265b43595'} Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:34:52.620536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:34:52.622105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:34:52.623797 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f4ba0e8e-fe7d-44bb-9289-106dfbd22f78 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:34:52.623797 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f4ba0e8e-fe7d-44bb-9289-106dfbd22f78 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 404 len: 111 microversion: 2.1 time: 0.028793 Jul 21 06:34:52.623797 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 347/679] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:52 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:34:52.628363 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5677b38d-5e9c-4b70-82cb-5fbcb83f3231 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '.version_select at 0x7f9327c3f550>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:52.647411 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5677b38d-5e9c-4b70-82cb-5fbcb83f3231 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-895641349" status: 202 len: 0 microversion: 2.1 time: 0.022899 Jul 21 06:34:52.648236 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 333/680] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jul 21 06:34:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-895641349 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:34:53.301809 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-18dadaac-44a6-4042-b8cc-2a552cc345d3 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:53.302339 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-18dadaac-44a6-4042-b8cc-2a552cc345d3 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:53.308336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18dadaac-44a6-4042-b8cc-2a552cc345d3 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:53.308783 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18dadaac-44a6-4042-b8cc-2a552cc345d3 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:53.309543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18dadaac-44a6-4042-b8cc-2a552cc345d3 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:53.310018 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18dadaac-44a6-4042-b8cc-2a552cc345d3 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:53.436127 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-18dadaac-44a6-4042-b8cc-2a552cc345d3 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lazy-loading 'services' on Instance uuid 43f81355-5e49-4559-b29c-b6faefe880b7 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:34:53.546048 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-18dadaac-44a6-4042-b8cc-2a552cc345d3 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-volume_attachments/54a2284c-0453-4c14-852c-c9fb62554395" status: 202 len: 0 microversion: 2.1 time: 0.247894 Jul 21 06:34:53.546655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 348/681] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:34:53 2022] DELETE /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-volume_attachments/54a2284c-0453-4c14-852c-c9fb62554395 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:34:53.555116 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ce8dcdc2-2b78-4ed3-bdde-56e305a92755 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:53.556052 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ce8dcdc2-2b78-4ed3-bdde-56e305a92755 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:53.564960 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce8dcdc2-2b78-4ed3-bdde-56e305a92755 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:53.565417 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce8dcdc2-2b78-4ed3-bdde-56e305a92755 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:53.566223 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce8dcdc2-2b78-4ed3-bdde-56e305a92755 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:53.566665 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce8dcdc2-2b78-4ed3-bdde-56e305a92755 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:53.595979 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ce8dcdc2-2b78-4ed3-bdde-56e305a92755 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Jul 21 06:34:53.596538 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 334/682] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:34:53 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:54.608476 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b3594c88-f1e7-4458-97cd-4d386f598429 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:54.609566 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b3594c88-f1e7-4458-97cd-4d386f598429 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:54.616340 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b3594c88-f1e7-4458-97cd-4d386f598429 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:54.616784 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b3594c88-f1e7-4458-97cd-4d386f598429 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:54.617550 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b3594c88-f1e7-4458-97cd-4d386f598429 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:54.618006 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b3594c88-f1e7-4458-97cd-4d386f598429 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:54.648482 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b3594c88-f1e7-4458-97cd-4d386f598429 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Jul 21 06:34:54.649056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 349/683] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:34:54 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:55.660850 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-cf4e03d1-893a-4851-a2ba-2824957fba66 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:55.661771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-cf4e03d1-893a-4851-a2ba-2824957fba66 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:55.668469 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cf4e03d1-893a-4851-a2ba-2824957fba66 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:55.668921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cf4e03d1-893a-4851-a2ba-2824957fba66 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:55.669690 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cf4e03d1-893a-4851-a2ba-2824957fba66 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:55.670164 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cf4e03d1-893a-4851-a2ba-2824957fba66 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:55.699224 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-cf4e03d1-893a-4851-a2ba-2824957fba66 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041750 Jul 21 06:34:55.699919 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 335/684] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:34:55 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:34:55.757503 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ead67952-0309-4dea-9e41-677f7058a7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:55.758035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ead67952-0309-4dea-9e41-677f7058a7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:55.765146 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ead67952-0309-4dea-9e41-677f7058a7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:55.765590 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ead67952-0309-4dea-9e41-677f7058a7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:55.766374 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ead67952-0309-4dea-9e41-677f7058a7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:55.766802 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ead67952-0309-4dea-9e41-677f7058a7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:55.791765 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ead67952-0309-4dea-9e41-677f7058a7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:34:55.840381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:55.865349 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ead67952-0309-4dea-9e41-677f7058a7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 204 len: 0 microversion: 2.1 time: 0.111579 Jul 21 06:34:55.866076 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 350/685] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:34:55 2022] DELETE /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:34:55.875732 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-565af369-7813-47a9-ae0a-4ed1531fcf43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:55.876364 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-565af369-7813-47a9-ae0a-4ed1531fcf43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:55.882296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-565af369-7813-47a9-ae0a-4ed1531fcf43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:55.882752 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-565af369-7813-47a9-ae0a-4ed1531fcf43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:55.883517 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-565af369-7813-47a9-ae0a-4ed1531fcf43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:55.883957 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-565af369-7813-47a9-ae0a-4ed1531fcf43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:56.017765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-565af369-7813-47a9-ae0a-4ed1531fcf43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:56.021291 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:34:56.026734 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-565af369-7813-47a9-ae0a-4ed1531fcf43 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1682 microversion: 2.1 time: 0.155214 Jul 21 06:34:56.027404 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 336/686] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:55 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:56.145150 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c862f62d-553a-4aee-94b3-2aaab0e914af tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:56.145731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c862f62d-553a-4aee-94b3-2aaab0e914af tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:56.152403 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c862f62d-553a-4aee-94b3-2aaab0e914af tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:56.152852 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c862f62d-553a-4aee-94b3-2aaab0e914af tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:56.153609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c862f62d-553a-4aee-94b3-2aaab0e914af tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:56.154074 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c862f62d-553a-4aee-94b3-2aaab0e914af tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:56.238708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-c862f62d-553a-4aee-94b3-2aaab0e914af tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lazy-loading 'services' on Instance uuid 6957ca3e-0c2d-413b-bbb5-f77c452e0398 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:34:56.309608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c862f62d-553a-4aee-94b3-2aaab0e914af tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398/os-volume_attachments/941c832f-a699-4464-8ac3-b00fdec54941" status: 202 len: 0 microversion: 2.1 time: 0.168472 Jul 21 06:34:56.310233 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 351/687] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:34:56 2022] DELETE /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398/os-volume_attachments/941c832f-a699-4464-8ac3-b00fdec54941 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:34:57.043896 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-46e3db0c-a571-4b92-8c56-a1451860d235 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:57.044433 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-46e3db0c-a571-4b92-8c56-a1451860d235 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:57.052372 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-46e3db0c-a571-4b92-8c56-a1451860d235 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:57.052824 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-46e3db0c-a571-4b92-8c56-a1451860d235 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:57.053603 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-46e3db0c-a571-4b92-8c56-a1451860d235 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:57.054087 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-46e3db0c-a571-4b92-8c56-a1451860d235 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:57.190157 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-46e3db0c-a571-4b92-8c56-a1451860d235 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:57.197547 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-46e3db0c-a571-4b92-8c56-a1451860d235 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1682 microversion: 2.1 time: 0.158181 Jul 21 06:34:57.198149 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 337/688] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:57 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:58.216735 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b203befc-218f-462b-9831-0e26cc4e2d9d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:58.217374 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b203befc-218f-462b-9831-0e26cc4e2d9d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:58.223645 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b203befc-218f-462b-9831-0e26cc4e2d9d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:58.224088 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b203befc-218f-462b-9831-0e26cc4e2d9d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:58.224857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b203befc-218f-462b-9831-0e26cc4e2d9d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:58.225296 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b203befc-218f-462b-9831-0e26cc4e2d9d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:58.357166 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b203befc-218f-462b-9831-0e26cc4e2d9d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:58.364971 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b203befc-218f-462b-9831-0e26cc4e2d9d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1682 microversion: 2.1 time: 0.153189 Jul 21 06:34:58.365550 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 352/689] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:58 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:34:59.177611 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-333ae9de-777a-4c78-b35c-e086dd83288e req-10757444-35b0-416d-abda-065856dc2a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f81355-5e49-4559-b29c-b6faefe880b7", "name": "network-vif-deleted", "tag": "0004c418-8336-40b0-9995-58b47e33de84"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:34:59.187409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-333ae9de-777a-4c78-b35c-e086dd83288e req-10757444-35b0-416d-abda-065856dc2a74 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:59.187865 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-333ae9de-777a-4c78-b35c-e086dd83288e req-10757444-35b0-416d-abda-065856dc2a74 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:59.199934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-333ae9de-777a-4c78-b35c-e086dd83288e req-10757444-35b0-416d-abda-065856dc2a74 service nova] Creating event network-vif-deleted:0004c418-8336-40b0-9995-58b47e33de84 for instance 43f81355-5e49-4559-b29c-b6faefe880b7 on hv-cinder-85031 Jul 21 06:34:59.204817 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-333ae9de-777a-4c78-b35c-e086dd83288e req-10757444-35b0-416d-abda-065856dc2a74 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030900 Jul 21 06:34:59.205759 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 338/690] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:34:59.383248 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:59.384757 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:59.392792 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:59.393317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:59.394309 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:59.394885 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:59.426945 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:59.427388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:59.427836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lazy-loading 'fault' on Instance uuid 43f81355-5e49-4559-b29c-b6faefe880b7 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:34:59.471940 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:59.480309 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6bcb772b-966e-4b75-b6f6-94ec0c1fb61f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1331 microversion: 2.1 time: 0.100286 Jul 21 06:34:59.481130 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 353/691] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:59 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:34:59.535796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-519b5a3c-e877-4e5e-97a0-314da2992fb3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:59.536384 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-519b5a3c-e877-4e5e-97a0-314da2992fb3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:59.543251 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-519b5a3c-e877-4e5e-97a0-314da2992fb3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:59.543515 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-519b5a3c-e877-4e5e-97a0-314da2992fb3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:59.544282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-519b5a3c-e877-4e5e-97a0-314da2992fb3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:59.544719 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-519b5a3c-e877-4e5e-97a0-314da2992fb3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:59.569211 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-519b5a3c-e877-4e5e-97a0-314da2992fb3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:34:59.644430 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-519b5a3c-e877-4e5e-97a0-314da2992fb3 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 204 len: 0 microversion: 2.1 time: 0.112474 Jul 21 06:34:59.645321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 339/692] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:34:59 2022] DELETE /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:34:59.654133 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-584891e4-f062-4db8-a55c-3f38f6db6df1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:34:59.654743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-584891e4-f062-4db8-a55c-3f38f6db6df1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:34:59.660918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-584891e4-f062-4db8-a55c-3f38f6db6df1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:59.661373 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-584891e4-f062-4db8-a55c-3f38f6db6df1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:59.662191 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-584891e4-f062-4db8-a55c-3f38f6db6df1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:34:59.662632 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-584891e4-f062-4db8-a55c-3f38f6db6df1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:34:59.797037 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-584891e4-f062-4db8-a55c-3f38f6db6df1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:34:59.805462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-584891e4-f062-4db8-a55c-3f38f6db6df1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1512 microversion: 2.1 time: 0.155732 Jul 21 06:34:59.806268 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 354/693] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:34:59 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:00.498483 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:00.499185 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:00.505664 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:00.506159 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:00.506928 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:00.507359 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:00.537728 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:00.538203 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:00.538655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lazy-loading 'fault' on Instance uuid 43f81355-5e49-4559-b29c-b6faefe880b7 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:00.584398 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:00.591955 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2fc43ec7-32e9-4194-aa20-271cf71c4391 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 200 len: 1331 microversion: 2.1 time: 0.098296 Jul 21 06:35:00.592533 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 340/694] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:00 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:00.823739 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9698e04c-cb09-4f81-880d-bfeab45df349 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:00.824383 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9698e04c-cb09-4f81-880d-bfeab45df349 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:00.830945 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9698e04c-cb09-4f81-880d-bfeab45df349 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:00.831450 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9698e04c-cb09-4f81-880d-bfeab45df349 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:00.832347 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9698e04c-cb09-4f81-880d-bfeab45df349 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:00.832776 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9698e04c-cb09-4f81-880d-bfeab45df349 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:00.965575 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9698e04c-cb09-4f81-880d-bfeab45df349 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:00.972924 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9698e04c-cb09-4f81-880d-bfeab45df349 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1512 microversion: 2.1 time: 0.153227 Jul 21 06:35:00.973484 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 355/695] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:00 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:01.609863 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8d68dc5c-def6-41f5-9f6b-5ec5d401e564 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:01.610779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8d68dc5c-def6-41f5-9f6b-5ec5d401e564 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:01.617736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d68dc5c-def6-41f5-9f6b-5ec5d401e564 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:01.618296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d68dc5c-def6-41f5-9f6b-5ec5d401e564 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:01.619046 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d68dc5c-def6-41f5-9f6b-5ec5d401e564 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:01.619491 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d68dc5c-def6-41f5-9f6b-5ec5d401e564 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:01.635400 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-8d68dc5c-def6-41f5-9f6b-5ec5d401e564 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8d68dc5c-def6-41f5-9f6b-5ec5d401e564 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 HTTP/1.1 Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:35:01.637128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:35:01.638699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '43f81355-5e49-4559-b29c-b6faefe880b7'} Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:35:01.639584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:35:01.640736 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:01.641804 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8d68dc5c-def6-41f5-9f6b-5ec5d401e564 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:35:01.641804 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8d68dc5c-def6-41f5-9f6b-5ec5d401e564 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 404 len: 111 microversion: 2.1 time: 0.033858 Jul 21 06:35:01.641804 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 341/696] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:01 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:35:01.647342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e17b1e83-7ea4-48a5-afa3-d661a9908703 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '.version_select at 0x7f9327ac21f0>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:01.666168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e17b1e83-7ea4-48a5-afa3-d661a9908703 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053704130" status: 202 len: 0 microversion: 2.1 time: 0.022545 Jul 21 06:35:01.666737 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 356/697] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jul 21 06:35:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053704130 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:35:01.991410 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-62d086f5-d50a-475b-9ced-7ddca29335bd tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:01.992035 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-62d086f5-d50a-475b-9ced-7ddca29335bd tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:01.999078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62d086f5-d50a-475b-9ced-7ddca29335bd tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:01.999552 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62d086f5-d50a-475b-9ced-7ddca29335bd tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:02.000328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62d086f5-d50a-475b-9ced-7ddca29335bd tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:02.001076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-62d086f5-d50a-475b-9ced-7ddca29335bd tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:02.223190 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-62d086f5-d50a-475b-9ced-7ddca29335bd tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:02.231476 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-62d086f5-d50a-475b-9ced-7ddca29335bd tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 200 len: 1512 microversion: 2.1 time: 0.243974 Jul 21 06:35:02.239569 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 342/698] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:01 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:02.397427 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0502a216-7103-48cb-9062-f4d07ad26b2f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: .version_select at 0x7f9327b47940>, body: {"keypair": {"name": "tempest-keypair-1491834606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyWjY40mrMAR1geI2YlykT6MdYWPAmwbfbifyJ47yT8YjWdiWGeENr84sNjMybvur+UWiRbfuoPppGWk/Z3+B45Ho8klAj+lqaG8KneuQtSVZEuKxkNkOfwoh0+YRsDRA=="}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:02.414259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-0502a216-7103-48cb-9062-f4d07ad26b2f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:35:02.419288 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-0502a216-7103-48cb-9062-f4d07ad26b2f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for user 5c54ac39faa84c7db5b9b63360216d7b and project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:35:02.441353 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0502a216-7103-48cb-9062-f4d07ad26b2f tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048718 Jul 21 06:35:02.447120 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 357/699] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 06:35:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:02.538422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-b3843259-85aa-46c5-b8c6-eaa04ff0f5b6 req-fbf355cf-c9a8-407d-8e00-5a76a03b509a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6957ca3e-0c2d-413b-bbb5-f77c452e0398", "name": "network-vif-deleted", "tag": "47424985-5a53-4d8b-97b6-2f5bbea4e8da"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:02.547873 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-b3843259-85aa-46c5-b8c6-eaa04ff0f5b6 req-fbf355cf-c9a8-407d-8e00-5a76a03b509a service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:02.548405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-b3843259-85aa-46c5-b8c6-eaa04ff0f5b6 req-fbf355cf-c9a8-407d-8e00-5a76a03b509a service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:02.561076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-b3843259-85aa-46c5-b8c6-eaa04ff0f5b6 req-fbf355cf-c9a8-407d-8e00-5a76a03b509a service nova] Creating event network-vif-deleted:47424985-5a53-4d8b-97b6-2f5bbea4e8da for instance 6957ca3e-0c2d-413b-bbb5-f77c452e0398 on hv-cinder-85031 Jul 21 06:35:02.566358 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-b3843259-85aa-46c5-b8c6-eaa04ff0f5b6 req-fbf355cf-c9a8-407d-8e00-5a76a03b509a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031965 Jul 21 06:35:02.567111 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 343/700] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:03.249408 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c490ff6a-49c9-4313-8797-51c7f34fdc75 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:03.250053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c490ff6a-49c9-4313-8797-51c7f34fdc75 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 6957ca3e-0c2d-413b-bbb5-f77c452e0398] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:03.255973 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c490ff6a-49c9-4313-8797-51c7f34fdc75 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:03.256418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c490ff6a-49c9-4313-8797-51c7f34fdc75 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:03.257971 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c490ff6a-49c9-4313-8797-51c7f34fdc75 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:03.258437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c490ff6a-49c9-4313-8797-51c7f34fdc75 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:03.275314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-c490ff6a-49c9-4313-8797-51c7f34fdc75 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] HTTP exception thrown: Instance 6957ca3e-0c2d-413b-bbb5-f77c452e0398 could not be found. Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c490ff6a-49c9-4313-8797-51c7f34fdc75 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Request method failure captured: Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 HTTP/1.1 Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PM8es5ETUXXh09-RFFmQhndXlOmW0FGNVD1qmemXDrz8XuWJlsa5LXRfprQM6Ewvw_JnGaeVtlvZmfGavq1P5Upe0-IAuvh_9GeQucSHDfRszD-LYWKDfCZFNsZkNc2ljda_AYlmTsKbHEH5FX18H0roEVtumh7cGWLEvisRASvlqA Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 854daeeee974410c9a0afafee795e72c Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1771296309 Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:35:03.277188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/854daeeee974410c9a0afafee795e72c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/854daeeee974410c9a0afafee795e72c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/854daeeee974410c9a0afafee795e72c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_854daeeee974410c9a0afafee795e72c"}]}] Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-VolumesSnapshotTestJSON-1771296309 Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 854daeeee974410c9a0afafee795e72c Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1771296309 Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-VolumesSnapshotTestJSON-1771296309-project Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: efafaa14b3e146eba88412c382a8b977 Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-VolumesSnapshotTestJSON-1771296309-project Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 6957ca3e-0c2d-413b-bbb5-f77c452e0398 could not be found. Jul 21 06:35:03.278927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '6957ca3e-0c2d-413b-bbb5-f77c452e0398'} Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6957ca3e-0c2d-413b-bbb5-f77c452e0398 could not be found. Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:35:03.279848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6957ca3e-0c2d-413b-bbb5-f77c452e0398 could not be found. Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6957ca3e-0c2d-413b-bbb5-f77c452e0398 could not be found. Jul 21 06:35:03.283769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:03.285037 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c490ff6a-49c9-4313-8797-51c7f34fdc75 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Returning 404 to user: Instance 6957ca3e-0c2d-413b-bbb5-f77c452e0398 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:35:03.285037 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c490ff6a-49c9-4313-8797-51c7f34fdc75 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398" status: 404 len: 111 microversion: 2.1 time: 0.034935 Jul 21 06:35:03.285037 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 358/701] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:03 2022] GET /compute/v2.1/servers/6957ca3e-0c2d-413b-bbb5-f77c452e0398 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:35:03.678066 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1601214922", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fac3a692-b3e2-4555-a0ad-f0227031fd7d"}], "security_groups": [{"name": "tempest-securitygroup--1920026847"}], "key_name": "tempest-keypair-1491834606", "user_data": "}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:03.780661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.network.neutron [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] validate_networks() for [('fac3a692-b3e2-4555-a0ad-f0227031fd7d', None, None, None, None, None)] {{(pid=117905) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:35:04.137490 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Flavor limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:35:04.137920 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Image limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:35:04.138510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Flavor pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:35:04.138924 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Image pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:35:04.139368 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:35:04.148551 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:04.148999 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:04.149798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:04.150268 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:04.167782 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:35:04.171694 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for user 5c54ac39faa84c7db5b9b63360216d7b and project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:35:04.182415 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Going to run 1 instances... {{(pid=117905) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:35:04.184715 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:35:04.230177 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-43c80ca1-2298-47f3-8751-f3603b0092cb tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.557258 Jul 21 06:35:04.230831 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 344/702] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:35:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:35:04.241683 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-61241b9f-632b-45f3-a13e-60dfec7ed58c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:04.242417 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-61241b9f-632b-45f3-a13e-60dfec7ed58c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:04.298437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-61241b9f-632b-45f3-a13e-60dfec7ed58c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:04.305061 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-61241b9f-632b-45f3-a13e-60dfec7ed58c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1242 microversion: 2.1 time: 0.067722 Jul 21 06:35:04.305623 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 359/703] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:04 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:05.322589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-570587e4-8027-40c6-8cb9-eda2bd846249 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:05.323099 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-570587e4-8027-40c6-8cb9-eda2bd846249 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:05.326060 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:05.332116 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-570587e4-8027-40c6-8cb9-eda2bd846249 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:05.332565 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-570587e4-8027-40c6-8cb9-eda2bd846249 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:05.333322 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-570587e4-8027-40c6-8cb9-eda2bd846249 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:05.333759 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-570587e4-8027-40c6-8cb9-eda2bd846249 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:05.395817 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-570587e4-8027-40c6-8cb9-eda2bd846249 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:05.403956 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-570587e4-8027-40c6-8cb9-eda2bd846249 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1246 microversion: 2.1 time: 0.085825 Jul 21 06:35:05.404520 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 345/704] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:05 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:06.421083 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-82505f47-380b-4afa-8744-3e63f44e0189 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:06.421731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-82505f47-380b-4afa-8744-3e63f44e0189 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:06.429064 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-82505f47-380b-4afa-8744-3e63f44e0189 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:06.429512 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-82505f47-380b-4afa-8744-3e63f44e0189 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:06.430305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-82505f47-380b-4afa-8744-3e63f44e0189 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:06.430741 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-82505f47-380b-4afa-8744-3e63f44e0189 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:06.493510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-82505f47-380b-4afa-8744-3e63f44e0189 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:06.501141 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-82505f47-380b-4afa-8744-3e63f44e0189 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1238 microversion: 2.1 time: 0.084614 Jul 21 06:35:06.501705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 360/705] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:06 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:07.518422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ed4323bd-c62f-430b-ad32-32c8b232732c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:07.519940 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ed4323bd-c62f-430b-ad32-32c8b232732c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:07.528040 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed4323bd-c62f-430b-ad32-32c8b232732c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:07.528577 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed4323bd-c62f-430b-ad32-32c8b232732c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:07.529546 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed4323bd-c62f-430b-ad32-32c8b232732c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:07.530167 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed4323bd-c62f-430b-ad32-32c8b232732c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:07.599723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ed4323bd-c62f-430b-ad32-32c8b232732c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:07.607488 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ed4323bd-c62f-430b-ad32-32c8b232732c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1300 microversion: 2.1 time: 0.092900 Jul 21 06:35:07.608071 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 346/706] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:07 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:08.481855 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-968355fe-5a18-4bf9-a64b-91ae5b54c1aa req-990107a8-484a-43fd-a674-33a2c1a03610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd58c058-dd88-4697-8b77-c6e64e146c12", "tag": "bc14977c-2f5f-4905-b7e5-abf33c78ca67"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:08.491968 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-968355fe-5a18-4bf9-a64b-91ae5b54c1aa req-990107a8-484a-43fd-a674-33a2c1a03610 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:08.492474 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-968355fe-5a18-4bf9-a64b-91ae5b54c1aa req-990107a8-484a-43fd-a674-33a2c1a03610 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:08.506831 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-968355fe-5a18-4bf9-a64b-91ae5b54c1aa req-990107a8-484a-43fd-a674-33a2c1a03610 service nova] Creating event network-changed:bc14977c-2f5f-4905-b7e5-abf33c78ca67 for instance dd58c058-dd88-4697-8b77-c6e64e146c12 on hv-cinder-85031 Jul 21 06:35:08.512656 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-968355fe-5a18-4bf9-a64b-91ae5b54c1aa req-990107a8-484a-43fd-a674-33a2c1a03610 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035648 Jul 21 06:35:08.513367 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 361/707] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:08.625580 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-dcc696e8-66b6-44c1-bd35-7803c1fe2234 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:08.626234 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-dcc696e8-66b6-44c1-bd35-7803c1fe2234 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:08.632847 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dcc696e8-66b6-44c1-bd35-7803c1fe2234 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:08.633291 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dcc696e8-66b6-44c1-bd35-7803c1fe2234 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:08.634090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dcc696e8-66b6-44c1-bd35-7803c1fe2234 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:08.634524 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dcc696e8-66b6-44c1-bd35-7803c1fe2234 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:08.764233 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-dcc696e8-66b6-44c1-bd35-7803c1fe2234 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:08.771852 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-dcc696e8-66b6-44c1-bd35-7803c1fe2234 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1368 microversion: 2.1 time: 0.151434 Jul 21 06:35:08.772417 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 347/708] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:08 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:09.789589 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c79c4c02-4064-458f-bd9c-bce1c0913e1e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:09.790352 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c79c4c02-4064-458f-bd9c-bce1c0913e1e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:09.796665 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c79c4c02-4064-458f-bd9c-bce1c0913e1e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:09.797112 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c79c4c02-4064-458f-bd9c-bce1c0913e1e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:09.797865 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c79c4c02-4064-458f-bd9c-bce1c0913e1e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:09.798326 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c79c4c02-4064-458f-bd9c-bce1c0913e1e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:09.930460 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c79c4c02-4064-458f-bd9c-bce1c0913e1e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:09.938368 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c79c4c02-4064-458f-bd9c-bce1c0913e1e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1368 microversion: 2.1 time: 0.153486 Jul 21 06:35:09.938937 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 362/709] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:09 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:10.930206 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6c0d2d33-d2e3-4167-9aa1-3096becea42e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:10.930757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6c0d2d33-d2e3-4167-9aa1-3096becea42e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:10.938573 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6c0d2d33-d2e3-4167-9aa1-3096becea42e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:10.939038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6c0d2d33-d2e3-4167-9aa1-3096becea42e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:10.939802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6c0d2d33-d2e3-4167-9aa1-3096becea42e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:10.940237 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6c0d2d33-d2e3-4167-9aa1-3096becea42e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:10.957033 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-07375bfd-347d-466e-8018-e138c712cdde tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:10.957759 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-07375bfd-347d-466e-8018-e138c712cdde tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:10.963804 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-07375bfd-347d-466e-8018-e138c712cdde tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:10.964404 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-07375bfd-347d-466e-8018-e138c712cdde tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:10.965185 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-07375bfd-347d-466e-8018-e138c712cdde tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:10.965624 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-07375bfd-347d-466e-8018-e138c712cdde tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:10.973855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6c0d2d33-d2e3-4167-9aa1-3096becea42e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments/1cf0d2bd-22fc-4294-b879-ed1f4a397563" status: 200 len: 194 microversion: 2.20 time: 0.048004 Jul 21 06:35:10.980644 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 348/710] 10.222.0.42 () {60 vars in 1453 bytes} [Thu Jul 21 06:35:10 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments/1cf0d2bd-22fc-4294-b879-ed1f4a397563 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:35:11.051837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f8d90f7e-214a-4e21-bfed-b6ab68bdfade tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:11.052749 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f8d90f7e-214a-4e21-bfed-b6ab68bdfade tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:11.062545 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f8d90f7e-214a-4e21-bfed-b6ab68bdfade tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:11.063265 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f8d90f7e-214a-4e21-bfed-b6ab68bdfade tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:11.064088 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f8d90f7e-214a-4e21-bfed-b6ab68bdfade tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:11.064684 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f8d90f7e-214a-4e21-bfed-b6ab68bdfade tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:11.145124 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-07375bfd-347d-466e-8018-e138c712cdde tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:11.153350 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-07375bfd-347d-466e-8018-e138c712cdde tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1368 microversion: 2.1 time: 0.200899 Jul 21 06:35:11.162057 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-f8d90f7e-214a-4e21-bfed-b6ab68bdfade tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lazy-loading 'services' on Instance uuid a40d32b1-a161-49f9-a2ae-fe794e9a66cd {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:11.163089 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 363/711] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:10 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:11.171959 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1200742014", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "networks": [{"uuid": "2bc81270-f5d2-4da2-b2e3-48a4f6d8f429"}]}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:11.222986 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] validate_networks() for [('2bc81270-f5d2-4da2-b2e3-48a4f6d8f429', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:35:11.244036 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f8d90f7e-214a-4e21-bfed-b6ab68bdfade tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments/1cf0d2bd-22fc-4294-b879-ed1f4a397563" status: 202 len: 0 microversion: 2.20 time: 0.196598 Jul 21 06:35:11.244578 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 349/712] 10.222.0.42 () {60 vars in 1456 bytes} [Thu Jul 21 06:35:11 2022] DELETE /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments/1cf0d2bd-22fc-4294-b879-ed1f4a397563 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:35:11.257712 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-127f26ac-118e-4fc9-ab99-7fe9b3bb637a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:11.259189 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-127f26ac-118e-4fc9-ab99-7fe9b3bb637a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:11.268022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-127f26ac-118e-4fc9-ab99-7fe9b3bb637a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:11.268657 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-127f26ac-118e-4fc9-ab99-7fe9b3bb637a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:11.269468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-127f26ac-118e-4fc9-ab99-7fe9b3bb637a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:11.269909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-127f26ac-118e-4fc9-ab99-7fe9b3bb637a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:11.304404 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-127f26ac-118e-4fc9-ab99-7fe9b3bb637a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054651 Jul 21 06:35:11.305282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 350/713] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 06:35:11 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 06:35:11.586119 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:35:11.586549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:35:11.587027 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:35:11.587437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:35:11.587851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:35:11.597579 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:11.598051 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:11.598848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:11.599282 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:11.616198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Getting quotas for project 854daeeee974410c9a0afafee795e72c. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:35:11.620208 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Getting quotas for user efafaa14b3e146eba88412c382a8b977 and project 854daeeee974410c9a0afafee795e72c. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:35:11.630987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:35:11.633174 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:35:11.681305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f4c9ef02-102d-4645-8fd5-618a864fa9e5 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513072 Jul 21 06:35:11.687137 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 364/714] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:35:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 06:35:11.692355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-80dc0574-97b9-45c5-89d3-80e3d419a8e1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:11.692974 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-80dc0574-97b9-45c5-89d3-80e3d419a8e1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:11.748839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-80dc0574-97b9-45c5-89d3-80e3d419a8e1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:11.755635 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-80dc0574-97b9-45c5-89d3-80e3d419a8e1 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1219 microversion: 2.1 time: 0.067295 Jul 21 06:35:11.756208 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 351/715] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:11 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:12.170375 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7808e4e3-590f-4a2a-95b2-f5fcc1d18334 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:12.170910 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7808e4e3-590f-4a2a-95b2-f5fcc1d18334 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:12.177961 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7808e4e3-590f-4a2a-95b2-f5fcc1d18334 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:12.178438 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7808e4e3-590f-4a2a-95b2-f5fcc1d18334 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:12.179202 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7808e4e3-590f-4a2a-95b2-f5fcc1d18334 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:12.179637 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7808e4e3-590f-4a2a-95b2-f5fcc1d18334 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:12.312642 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7808e4e3-590f-4a2a-95b2-f5fcc1d18334 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:12.319247 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6ada877c-2b6f-4676-b64c-cdbeb4da4b8d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:12.320169 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7808e4e3-590f-4a2a-95b2-f5fcc1d18334 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1368 microversion: 2.1 time: 0.153708 Jul 21 06:35:12.320281 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6ada877c-2b6f-4676-b64c-cdbeb4da4b8d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:12.320728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 365/716] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:12 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:12.328391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6ada877c-2b6f-4676-b64c-cdbeb4da4b8d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:12.328845 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6ada877c-2b6f-4676-b64c-cdbeb4da4b8d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:12.329667 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6ada877c-2b6f-4676-b64c-cdbeb4da4b8d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:12.330175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6ada877c-2b6f-4676-b64c-cdbeb4da4b8d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:12.358141 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6ada877c-2b6f-4676-b64c-cdbeb4da4b8d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042767 Jul 21 06:35:12.358632 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 352/717] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 06:35:12 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:35:12.773294 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ad2937d3-8fe9-4849-ab5f-8317b9964a4f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:12.773910 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ad2937d3-8fe9-4849-ab5f-8317b9964a4f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:12.780373 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ad2937d3-8fe9-4849-ab5f-8317b9964a4f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:12.780822 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ad2937d3-8fe9-4849-ab5f-8317b9964a4f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:12.781595 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ad2937d3-8fe9-4849-ab5f-8317b9964a4f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:12.782060 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ad2937d3-8fe9-4849-ab5f-8317b9964a4f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:12.845471 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ad2937d3-8fe9-4849-ab5f-8317b9964a4f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:12.854935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ad2937d3-8fe9-4849-ab5f-8317b9964a4f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1223 microversion: 2.1 time: 0.085629 Jul 21 06:35:12.855521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 366/718] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:12 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:13.337336 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-af5e9eef-c442-4ec5-a644-14e43154f61c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:13.337881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-af5e9eef-c442-4ec5-a644-14e43154f61c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:13.345597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-af5e9eef-c442-4ec5-a644-14e43154f61c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:13.346088 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-af5e9eef-c442-4ec5-a644-14e43154f61c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:13.346869 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-af5e9eef-c442-4ec5-a644-14e43154f61c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:13.347321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-af5e9eef-c442-4ec5-a644-14e43154f61c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:13.369920 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-782d0dc4-416d-4fb7-b9d5-7b58acdd2a7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:13.370954 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-782d0dc4-416d-4fb7-b9d5-7b58acdd2a7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:13.378327 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-782d0dc4-416d-4fb7-b9d5-7b58acdd2a7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:13.378901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-782d0dc4-416d-4fb7-b9d5-7b58acdd2a7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:13.379741 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-782d0dc4-416d-4fb7-b9d5-7b58acdd2a7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:13.380281 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-782d0dc4-416d-4fb7-b9d5-7b58acdd2a7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:13.417559 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-782d0dc4-416d-4fb7-b9d5-7b58acdd2a7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051097 Jul 21 06:35:13.418272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 367/719] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 06:35:13 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:13.477035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bc71cda9-9646-4204-b545-e1d862042fdd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:13.477529 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bc71cda9-9646-4204-b545-e1d862042fdd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:13.484628 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc71cda9-9646-4204-b545-e1d862042fdd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:13.485076 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc71cda9-9646-4204-b545-e1d862042fdd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:13.485854 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc71cda9-9646-4204-b545-e1d862042fdd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:13.486296 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc71cda9-9646-4204-b545-e1d862042fdd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:13.512403 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bc71cda9-9646-4204-b545-e1d862042fdd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:35:13.588530 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bc71cda9-9646-4204-b545-e1d862042fdd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 204 len: 0 microversion: 2.20 time: 0.115075 Jul 21 06:35:13.590014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 368/720] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jul 21 06:35:13 2022] DELETE /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 21 06:35:13.598824 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a0fcb970-0c53-488d-bcbe-45ee91c70fde tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:13.599039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a0fcb970-0c53-488d-bcbe-45ee91c70fde tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:13.604853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a0fcb970-0c53-488d-bcbe-45ee91c70fde tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:13.605461 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a0fcb970-0c53-488d-bcbe-45ee91c70fde tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:13.606273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a0fcb970-0c53-488d-bcbe-45ee91c70fde tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:13.606714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a0fcb970-0c53-488d-bcbe-45ee91c70fde tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:13.660757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-af5e9eef-c442-4ec5-a644-14e43154f61c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:13.668594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-af5e9eef-c442-4ec5-a644-14e43154f61c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1368 microversion: 2.1 time: 0.335147 Jul 21 06:35:13.670139 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 353/721] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:13 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1368 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:13.752322 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a0fcb970-0c53-488d-bcbe-45ee91c70fde tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:13.755826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:13.762274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a0fcb970-0c53-488d-bcbe-45ee91c70fde tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:13.763807 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-a0fcb970-0c53-488d-bcbe-45ee91c70fde tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:13.764991 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a0fcb970-0c53-488d-bcbe-45ee91c70fde tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.170693 Jul 21 06:35:13.766911 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 369/722] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:13 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:35:13.873680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f6d16876-e0f9-4be6-8067-2c83f16a6f05 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:13.874250 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f6d16876-e0f9-4be6-8067-2c83f16a6f05 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:13.880546 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f6d16876-e0f9-4be6-8067-2c83f16a6f05 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:13.880995 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f6d16876-e0f9-4be6-8067-2c83f16a6f05 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:13.881755 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f6d16876-e0f9-4be6-8067-2c83f16a6f05 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:13.882239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f6d16876-e0f9-4be6-8067-2c83f16a6f05 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:13.901970 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:13.946323 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f6d16876-e0f9-4be6-8067-2c83f16a6f05 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:13.954296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f6d16876-e0f9-4be6-8067-2c83f16a6f05 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1279 microversion: 2.1 time: 0.085923 Jul 21 06:35:13.954861 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 354/723] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:13 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:14.687535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e65542a0-9360-4473-871c-0ec9b74a3867 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:14.688062 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e65542a0-9360-4473-871c-0ec9b74a3867 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:14.694963 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e65542a0-9360-4473-871c-0ec9b74a3867 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:14.695414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e65542a0-9360-4473-871c-0ec9b74a3867 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:14.696177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e65542a0-9360-4473-871c-0ec9b74a3867 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:14.696612 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e65542a0-9360-4473-871c-0ec9b74a3867 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:14.784647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-330acb4e-67b0-41dc-b899-85291ad50a7e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:14.785269 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-330acb4e-67b0-41dc-b899-85291ad50a7e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:14.787196 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:14.793662 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-330acb4e-67b0-41dc-b899-85291ad50a7e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:14.794459 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-330acb4e-67b0-41dc-b899-85291ad50a7e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:14.795003 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-330acb4e-67b0-41dc-b899-85291ad50a7e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:14.795447 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-330acb4e-67b0-41dc-b899-85291ad50a7e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:14.826045 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e65542a0-9360-4473-871c-0ec9b74a3867 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:14.833969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e65542a0-9360-4473-871c-0ec9b74a3867 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1368 microversion: 2.1 time: 0.151547 Jul 21 06:35:14.834546 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 370/724] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:14 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:14.925468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-330acb4e-67b0-41dc-b899-85291ad50a7e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:14.934180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-330acb4e-67b0-41dc-b899-85291ad50a7e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:14.935695 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-330acb4e-67b0-41dc-b899-85291ad50a7e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:14.936856 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-330acb4e-67b0-41dc-b899-85291ad50a7e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.156271 Jul 21 06:35:14.937419 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 355/725] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:14 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:14.971313 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-fe1067c0-708a-4ee6-8d61-956f912cbf41 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:14.971929 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-fe1067c0-708a-4ee6-8d61-956f912cbf41 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:14.977864 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fe1067c0-708a-4ee6-8d61-956f912cbf41 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:14.978351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fe1067c0-708a-4ee6-8d61-956f912cbf41 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:14.979109 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fe1067c0-708a-4ee6-8d61-956f912cbf41 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:14.980050 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fe1067c0-708a-4ee6-8d61-956f912cbf41 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:15.039292 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fe1067c0-708a-4ee6-8d61-956f912cbf41 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:15.047159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-fe1067c0-708a-4ee6-8d61-956f912cbf41 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1279 microversion: 2.1 time: 0.079649 Jul 21 06:35:15.047731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 371/726] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:14 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1279 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:15.851683 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-84d4bce0-e12f-48ba-9c28-7fdf62b66037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:15.852341 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-84d4bce0-e12f-48ba-9c28-7fdf62b66037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:15.860119 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-84d4bce0-e12f-48ba-9c28-7fdf62b66037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:15.860570 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-84d4bce0-e12f-48ba-9c28-7fdf62b66037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:15.861338 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-84d4bce0-e12f-48ba-9c28-7fdf62b66037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:15.861771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-84d4bce0-e12f-48ba-9c28-7fdf62b66037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:15.956829 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-388e2657-8434-41eb-9c69-3fa9a89eeb2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:15.958272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-388e2657-8434-41eb-9c69-3fa9a89eeb2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:15.969183 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-388e2657-8434-41eb-9c69-3fa9a89eeb2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:15.969713 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-388e2657-8434-41eb-9c69-3fa9a89eeb2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:15.971098 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-388e2657-8434-41eb-9c69-3fa9a89eeb2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:15.971611 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-388e2657-8434-41eb-9c69-3fa9a89eeb2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:16.395297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-84d4bce0-e12f-48ba-9c28-7fdf62b66037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:16.404026 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-84d4bce0-e12f-48ba-9c28-7fdf62b66037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1368 microversion: 2.1 time: 0.556669 Jul 21 06:35:16.404704 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 356/727] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:15 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1368 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:16.416792 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-dc3bdd46-503a-4bce-ae55-f549182d0d1d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:16.418625 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-dc3bdd46-503a-4bce-ae55-f549182d0d1d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:16.424922 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dc3bdd46-503a-4bce-ae55-f549182d0d1d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:16.425373 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dc3bdd46-503a-4bce-ae55-f549182d0d1d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:16.426213 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dc3bdd46-503a-4bce-ae55-f549182d0d1d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:16.426611 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dc3bdd46-503a-4bce-ae55-f549182d0d1d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:16.464407 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-388e2657-8434-41eb-9c69-3fa9a89eeb2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:16.472705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-388e2657-8434-41eb-9c69-3fa9a89eeb2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:16.474244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-388e2657-8434-41eb-9c69-3fa9a89eeb2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:16.475438 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-388e2657-8434-41eb-9c69-3fa9a89eeb2f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1725 microversion: 2.20 time: 0.524222 Jul 21 06:35:16.476073 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 372/728] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:15 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1725 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:35:16.716902 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-1b3db8f9-28c1-4fff-bc78-82140dc207ab req-ec3fc853-fd6b-4144-aa25-d938ca5fddf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff99e0c-a820-4b04-8b0d-11dd7a778394", "tag": "fa58ed41-a634-46cf-b791-e38329e29479"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:16.720402 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:16.728751 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-1b3db8f9-28c1-4fff-bc78-82140dc207ab req-ec3fc853-fd6b-4144-aa25-d938ca5fddf4 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:16.730039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-1b3db8f9-28c1-4fff-bc78-82140dc207ab req-ec3fc853-fd6b-4144-aa25-d938ca5fddf4 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:16.742819 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-dc3bdd46-503a-4bce-ae55-f549182d0d1d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:16.754027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-dc3bdd46-503a-4bce-ae55-f549182d0d1d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1319 microversion: 2.1 time: 0.347908 Jul 21 06:35:16.755339 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 357/729] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:16 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:16.771982 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-1b3db8f9-28c1-4fff-bc78-82140dc207ab req-ec3fc853-fd6b-4144-aa25-d938ca5fddf4 service nova] Creating event network-changed:fa58ed41-a634-46cf-b791-e38329e29479 for instance 5ff99e0c-a820-4b04-8b0d-11dd7a778394 on hv-cinder-85031 Jul 21 06:35:16.779202 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-1b3db8f9-28c1-4fff-bc78-82140dc207ab req-ec3fc853-fd6b-4144-aa25-d938ca5fddf4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067123 Jul 21 06:35:16.780321 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 373/730] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:17.226388 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-b23460af-42af-423a-9210-7f6a6b8ec615 req-40b85450-29e8-4fa6-9b96-429c2318b539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40d32b1-a161-49f9-a2ae-fe794e9a66cd", "name": "network-vif-deleted", "tag": "345fc32c-f55c-4636-be16-4b276cd0c105"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:17.235968 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-b23460af-42af-423a-9210-7f6a6b8ec615 req-40b85450-29e8-4fa6-9b96-429c2318b539 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:17.236640 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-b23460af-42af-423a-9210-7f6a6b8ec615 req-40b85450-29e8-4fa6-9b96-429c2318b539 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:17.249348 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-b23460af-42af-423a-9210-7f6a6b8ec615 req-40b85450-29e8-4fa6-9b96-429c2318b539 service nova] Creating event network-vif-deleted:345fc32c-f55c-4636-be16-4b276cd0c105 for instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd on hv-cinder-85031 Jul 21 06:35:17.255009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-b23460af-42af-423a-9210-7f6a6b8ec615 req-40b85450-29e8-4fa6-9b96-429c2318b539 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032123 Jul 21 06:35:17.256272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 358/731] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:17.421853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7f7f9146-0846-4c7e-a8e1-4c0485da20a2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:17.422700 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7f7f9146-0846-4c7e-a8e1-4c0485da20a2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:17.429275 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f7f9146-0846-4c7e-a8e1-4c0485da20a2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:17.429720 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f7f9146-0846-4c7e-a8e1-4c0485da20a2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:17.430509 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f7f9146-0846-4c7e-a8e1-4c0485da20a2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:17.430942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f7f9146-0846-4c7e-a8e1-4c0485da20a2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:17.496318 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-822b746b-3b3a-45b6-a0bb-84d800e37138 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:17.497034 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-822b746b-3b3a-45b6-a0bb-84d800e37138 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:17.504007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-822b746b-3b3a-45b6-a0bb-84d800e37138 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:17.504466 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-822b746b-3b3a-45b6-a0bb-84d800e37138 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:17.505398 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-822b746b-3b3a-45b6-a0bb-84d800e37138 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:17.505865 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-822b746b-3b3a-45b6-a0bb-84d800e37138 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:17.598382 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-822b746b-3b3a-45b6-a0bb-84d800e37138 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:17.611571 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-822b746b-3b3a-45b6-a0bb-84d800e37138 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:17.613525 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-822b746b-3b3a-45b6-a0bb-84d800e37138 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:17.614937 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-822b746b-3b3a-45b6-a0bb-84d800e37138 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1367 microversion: 2.20 time: 0.123827 Jul 21 06:35:17.616027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 359/732] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:17 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1367 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:35:17.665208 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7f7f9146-0846-4c7e-a8e1-4c0485da20a2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:17.673762 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7f7f9146-0846-4c7e-a8e1-4c0485da20a2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1368 microversion: 2.1 time: 0.256723 Jul 21 06:35:17.674385 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 374/733] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:17 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:17.777139 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2b5310bf-2bfa-4205-917c-8f4567d62ced tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:17.777809 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2b5310bf-2bfa-4205-917c-8f4567d62ced tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:17.784328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b5310bf-2bfa-4205-917c-8f4567d62ced tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:17.784786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b5310bf-2bfa-4205-917c-8f4567d62ced tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:17.785591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b5310bf-2bfa-4205-917c-8f4567d62ced tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:17.786043 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2b5310bf-2bfa-4205-917c-8f4567d62ced tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:17.917496 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2b5310bf-2bfa-4205-917c-8f4567d62ced tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:17.925800 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2b5310bf-2bfa-4205-917c-8f4567d62ced tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1319 microversion: 2.1 time: 0.153313 Jul 21 06:35:17.926345 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 360/734] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:17 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:18.633815 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:18.634462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:18.641557 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:18.642050 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:18.642815 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:18.643254 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:18.673470 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:18.673912 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:18.674386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lazy-loading 'fault' on Instance uuid a40d32b1-a161-49f9-a2ae-fe794e9a66cd {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:18.691531 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-890fb7f7-53b9-4d93-8588-34ee85e53bbc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:18.692236 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-890fb7f7-53b9-4d93-8588-34ee85e53bbc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:18.700076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-890fb7f7-53b9-4d93-8588-34ee85e53bbc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:18.700600 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-890fb7f7-53b9-4d93-8588-34ee85e53bbc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:18.701443 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-890fb7f7-53b9-4d93-8588-34ee85e53bbc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:18.701884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-890fb7f7-53b9-4d93-8588-34ee85e53bbc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:18.716882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:18.725727 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:18.727438 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:18.728722 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c67c9b0e-ec32-408e-ad34-3b87960ea71b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 200 len: 1372 microversion: 2.20 time: 0.098825 Jul 21 06:35:18.731335 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 375/735] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:18 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:18.945544 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-91c9fead-eab4-4a63-a9ed-2a1c2b87636b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:18.946435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-91c9fead-eab4-4a63-a9ed-2a1c2b87636b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:18.953721 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-91c9fead-eab4-4a63-a9ed-2a1c2b87636b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:18.962089 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-91c9fead-eab4-4a63-a9ed-2a1c2b87636b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:18.963908 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-91c9fead-eab4-4a63-a9ed-2a1c2b87636b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:18.966285 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-91c9fead-eab4-4a63-a9ed-2a1c2b87636b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:19.061389 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-890fb7f7-53b9-4d93-8588-34ee85e53bbc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:19.069754 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-890fb7f7-53b9-4d93-8588-34ee85e53bbc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1368 microversion: 2.1 time: 0.382073 Jul 21 06:35:19.070370 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 361/736] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:18 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1368 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:19.076118 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-eb274e7c-c6cb-421a-aa5e-334e24488dda req-c9faccfb-e419-433b-8ee9-78a7b83e0fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd58c058-dd88-4697-8b77-c6e64e146c12", "name": "network-vif-plugged", "status": "completed", "tag": "bc14977c-2f5f-4905-b7e5-abf33c78ca67"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:19.084184 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-eb274e7c-c6cb-421a-aa5e-334e24488dda req-c9faccfb-e419-433b-8ee9-78a7b83e0fc7 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:19.084636 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-eb274e7c-c6cb-421a-aa5e-334e24488dda req-c9faccfb-e419-433b-8ee9-78a7b83e0fc7 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:19.097780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-eb274e7c-c6cb-421a-aa5e-334e24488dda req-c9faccfb-e419-433b-8ee9-78a7b83e0fc7 service nova] Creating event network-vif-plugged:bc14977c-2f5f-4905-b7e5-abf33c78ca67 for instance dd58c058-dd88-4697-8b77-c6e64e146c12 on hv-cinder-85031 Jul 21 06:35:19.102695 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-eb274e7c-c6cb-421a-aa5e-334e24488dda req-c9faccfb-e419-433b-8ee9-78a7b83e0fc7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030609 Jul 21 06:35:19.103299 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 362/737] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:19.224176 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-91c9fead-eab4-4a63-a9ed-2a1c2b87636b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:19.233403 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-91c9fead-eab4-4a63-a9ed-2a1c2b87636b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1319 microversion: 2.1 time: 0.294173 Jul 21 06:35:19.234337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 376/738] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:18 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:19.749521 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e52c5f4c-d3cd-4ce2-bea8-998334eeb607 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:19.750251 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e52c5f4c-d3cd-4ce2-bea8-998334eeb607 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:19.756460 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e52c5f4c-d3cd-4ce2-bea8-998334eeb607 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:19.756911 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e52c5f4c-d3cd-4ce2-bea8-998334eeb607 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:19.757676 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e52c5f4c-d3cd-4ce2-bea8-998334eeb607 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:19.758163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e52c5f4c-d3cd-4ce2-bea8-998334eeb607 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:19.771579 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-e52c5f4c-d3cd-4ce2-bea8-998334eeb607 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] HTTP exception thrown: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e52c5f4c-d3cd-4ce2-bea8-998334eeb607 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Request method failure captured: Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd HTTP/1.1 Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKLcBiTB48bwhPpmkRPF1O0ifR98sZqcVjQPZfkOMEv4bvmkZSwj78LCYfaxFbR_7GRJsNFBrxYCvmw99n3FzVA3eDgxRq2hC1xZlapH5WF_fxkxARBEoxbyFYQPSq2xXmxA2xXWg7MFo_JBQLTRiOZ1UWIpJqA-rXybEfOLADhg5U Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:35:19.773435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2be6e5aedba545f4b562423c55ddbf80"}]}] Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 15ec5e26839f494e98ec70ac49ebe415 Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:35:19.775138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': 'a40d32b1-a161-49f9-a2ae-fe794e9a66cd'} Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:35:19.776089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:35:19.778355 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:19.779728 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e52c5f4c-d3cd-4ce2-bea8-998334eeb607 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Returning 404 to user: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:35:19.779728 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e52c5f4c-d3cd-4ce2-bea8-998334eeb607 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 404 len: 111 microversion: 2.20 time: 0.030026 Jul 21 06:35:19.779728 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 363/739] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:19 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 06:35:19.784196 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-cba6dcc0-d2c2-44b8-85f5-902db6f6d706 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '.version_select at 0x7f9327a028b0>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:19.801326 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-cba6dcc0-d2c2-44b8-85f5-902db6f6d706 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446977107" status: 204 len: 0 microversion: 2.20 time: 0.020876 Jul 21 06:35:19.801894 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 377/740] 10.222.0.42 () {60 vars in 1261 bytes} [Thu Jul 21 06:35:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446977107 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 06:35:20.086524 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2ca42e27-d1f7-49bc-8bc5-a99a72369a6d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:20.087215 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2ca42e27-d1f7-49bc-8bc5-a99a72369a6d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:20.093701 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ca42e27-d1f7-49bc-8bc5-a99a72369a6d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:20.094181 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ca42e27-d1f7-49bc-8bc5-a99a72369a6d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:20.094946 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ca42e27-d1f7-49bc-8bc5-a99a72369a6d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:20.095381 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2ca42e27-d1f7-49bc-8bc5-a99a72369a6d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:20.226166 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2ca42e27-d1f7-49bc-8bc5-a99a72369a6d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:20.234261 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2ca42e27-d1f7-49bc-8bc5-a99a72369a6d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1368 microversion: 2.1 time: 0.151483 Jul 21 06:35:20.234833 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 364/741] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:20 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:20.250397 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2bd35121-ae9b-426b-b06c-76afec6ce9c4 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:20.251012 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2bd35121-ae9b-426b-b06c-76afec6ce9c4 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:20.257151 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2bd35121-ae9b-426b-b06c-76afec6ce9c4 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:20.257649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2bd35121-ae9b-426b-b06c-76afec6ce9c4 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:20.258534 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2bd35121-ae9b-426b-b06c-76afec6ce9c4 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:20.259036 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2bd35121-ae9b-426b-b06c-76afec6ce9c4 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:20.397569 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2bd35121-ae9b-426b-b06c-76afec6ce9c4 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:20.407722 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2bd35121-ae9b-426b-b06c-76afec6ce9c4 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1319 microversion: 2.1 time: 0.160535 Jul 21 06:35:20.407722 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 378/742] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:20 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:20.444021 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e14e7baa-9bf8-49bf-b1f4-265eb9a22601 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Action: 'create', calling method: .version_select at 0x7f9338361940>, body: {"keypair": {"name": "tempest-keypair-1681003305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbDOGBJdgLcj6MAfiVq7Igke0OyMifoFv+J/nv7IjMthUr8PyZA82Y0NQ1pIbeJVL0RU3W8geafP736otHg1xBtC3dhMnK5/1mWwMx/98Zj4RcYG2GjC6ed9gMsuNHV7w=="}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:20.458489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-e14e7baa-9bf8-49bf-b1f4-265eb9a22601 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Getting quotas for project 2be6e5aedba545f4b562423c55ddbf80. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:35:20.462258 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-e14e7baa-9bf8-49bf-b1f4-265eb9a22601 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Getting quotas for user 15ec5e26839f494e98ec70ac49ebe415 and project 2be6e5aedba545f4b562423c55ddbf80. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:35:20.483576 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e14e7baa-9bf8-49bf-b1f4-265eb9a22601 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043452 Jul 21 06:35:20.484172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 365/743] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Jul 21 06:35:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 06:35:21.251767 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-280b03e8-62cc-4f85-97c5-a65805bfb98e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:21.252381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-280b03e8-62cc-4f85-97c5-a65805bfb98e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:21.258832 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-280b03e8-62cc-4f85-97c5-a65805bfb98e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:21.259282 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-280b03e8-62cc-4f85-97c5-a65805bfb98e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:21.260073 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-280b03e8-62cc-4f85-97c5-a65805bfb98e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:21.260513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-280b03e8-62cc-4f85-97c5-a65805bfb98e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:21.425228 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-791fe1f3-978a-4c47-b82e-121063f46254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:21.425835 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-791fe1f3-978a-4c47-b82e-121063f46254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:21.432260 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-791fe1f3-978a-4c47-b82e-121063f46254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:21.433428 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-791fe1f3-978a-4c47-b82e-121063f46254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:21.434325 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-791fe1f3-978a-4c47-b82e-121063f46254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:21.434770 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-791fe1f3-978a-4c47-b82e-121063f46254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:21.493359 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-280b03e8-62cc-4f85-97c5-a65805bfb98e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:21.501969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-280b03e8-62cc-4f85-97c5-a65805bfb98e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1559 microversion: 2.1 time: 0.253943 Jul 21 06:35:21.502875 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 379/744] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:21 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1559 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:21.520009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7bc016b7-4b55-400b-9425-d605e1bd905a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:21.520764 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7bc016b7-4b55-400b-9425-d605e1bd905a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:21.527264 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7bc016b7-4b55-400b-9425-d605e1bd905a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:21.527724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7bc016b7-4b55-400b-9425-d605e1bd905a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:21.528851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7bc016b7-4b55-400b-9425-d605e1bd905a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:21.529302 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7bc016b7-4b55-400b-9425-d605e1bd905a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:21.607468 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:21.627004 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=12 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:21.684391 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7bc016b7-4b55-400b-9425-d605e1bd905a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169173 Jul 21 06:35:21.685116 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 380/745] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 06:35:21 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:35:21.713422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-791fe1f3-978a-4c47-b82e-121063f46254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:21.721493 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-791fe1f3-978a-4c47-b82e-121063f46254 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1319 microversion: 2.1 time: 0.300719 Jul 21 06:35:21.724576 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 366/746] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:21 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:21.923662 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1031124605", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57bee45f-12cb-4a98-816f-3a63d161af66"}], "security_groups": [{"name": "tempest-securitygroup--512219984"}], "key_name": "tempest-keypair-1681003305", "user_data": "}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:22.031835 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] validate_networks() for [('57bee45f-12cb-4a98-816f-3a63d161af66', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:35:22.415350 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:35:22.415936 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:35:22.416287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:35:22.416697 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:35:22.418338 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:35:22.427545 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:22.427993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:22.428825 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:22.429264 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:22.445885 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Getting quotas for project 2be6e5aedba545f4b562423c55ddbf80. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:35:22.450073 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Getting quotas for user 15ec5e26839f494e98ec70ac49ebe415 and project 2be6e5aedba545f4b562423c55ddbf80. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:35:22.461217 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:35:22.463644 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:35:22.510782 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4e2161c0-d3d3-4853-a0fe-550c57fd2e5c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.591343 Jul 21 06:35:22.512101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 381/747] 10.222.0.42 () {62 vars in 1187 bytes} [Thu Jul 21 06:35:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 06:35:22.522358 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-daef1cfc-f601-40b1-892f-0c4e40fe8182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:22.523353 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-daef1cfc-f601-40b1-892f-0c4e40fe8182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:22.586344 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-daef1cfc-f601-40b1-892f-0c4e40fe8182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:22.595244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-daef1cfc-f601-40b1-892f-0c4e40fe8182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:22.596786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-daef1cfc-f601-40b1-892f-0c4e40fe8182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:22.598122 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-daef1cfc-f601-40b1-892f-0c4e40fe8182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1282 microversion: 2.20 time: 0.080187 Jul 21 06:35:22.598683 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 367/748] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:22 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:35:22.740312 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9260be1a-64a5-4143-a54b-8e72c8926c7a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:22.741281 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9260be1a-64a5-4143-a54b-8e72c8926c7a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:22.748197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9260be1a-64a5-4143-a54b-8e72c8926c7a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:22.748731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9260be1a-64a5-4143-a54b-8e72c8926c7a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:22.749619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9260be1a-64a5-4143-a54b-8e72c8926c7a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:22.750322 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9260be1a-64a5-4143-a54b-8e72c8926c7a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:22.915666 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9260be1a-64a5-4143-a54b-8e72c8926c7a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:22.926095 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9260be1a-64a5-4143-a54b-8e72c8926c7a tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1319 microversion: 2.1 time: 0.190338 Jul 21 06:35:22.936497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 382/749] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:22 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:22.990895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-22cea01a-a7ea-4b55-ac8a-6b998a8a0cb5 req-36d6a840-6c17-44bd-add1-1ff211cc0b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd58c058-dd88-4697-8b77-c6e64e146c12", "tag": "bc14977c-2f5f-4905-b7e5-abf33c78ca67"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:23.004699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-22cea01a-a7ea-4b55-ac8a-6b998a8a0cb5 req-36d6a840-6c17-44bd-add1-1ff211cc0b1b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:23.004867 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-570d7a8b-201d-48d2-8d72-c5465bae0244 req-808bef43-6021-4424-a492-ca47f95268d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff99e0c-a820-4b04-8b0d-11dd7a778394", "name": "network-vif-plugged", "status": "completed", "tag": "fa58ed41-a634-46cf-b791-e38329e29479"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:23.005748 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-22cea01a-a7ea-4b55-ac8a-6b998a8a0cb5 req-36d6a840-6c17-44bd-add1-1ff211cc0b1b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:23.020040 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-570d7a8b-201d-48d2-8d72-c5465bae0244 req-808bef43-6021-4424-a492-ca47f95268d9 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:23.020250 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-22cea01a-a7ea-4b55-ac8a-6b998a8a0cb5 req-36d6a840-6c17-44bd-add1-1ff211cc0b1b service nova] Creating event network-changed:bc14977c-2f5f-4905-b7e5-abf33c78ca67 for instance dd58c058-dd88-4697-8b77-c6e64e146c12 on hv-cinder-85031 Jul 21 06:35:23.022445 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-570d7a8b-201d-48d2-8d72-c5465bae0244 req-808bef43-6021-4424-a492-ca47f95268d9 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:23.028177 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-22cea01a-a7ea-4b55-ac8a-6b998a8a0cb5 req-36d6a840-6c17-44bd-add1-1ff211cc0b1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041130 Jul 21 06:35:23.031439 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 368/750] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:23.059679 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-570d7a8b-201d-48d2-8d72-c5465bae0244 req-808bef43-6021-4424-a492-ca47f95268d9 service nova] Creating event network-vif-plugged:fa58ed41-a634-46cf-b791-e38329e29479 for instance 5ff99e0c-a820-4b04-8b0d-11dd7a778394 on hv-cinder-85031 Jul 21 06:35:23.067139 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-570d7a8b-201d-48d2-8d72-c5465bae0244 req-808bef43-6021-4424-a492-ca47f95268d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066830 Jul 21 06:35:23.069721 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 383/751] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:35:23.617735 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-afd92c72-897a-4012-9056-f098c2be4d4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:23.618374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-afd92c72-897a-4012-9056-f098c2be4d4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:23.625275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-afd92c72-897a-4012-9056-f098c2be4d4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:23.625721 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-afd92c72-897a-4012-9056-f098c2be4d4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:23.626504 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-afd92c72-897a-4012-9056-f098c2be4d4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:23.626947 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-afd92c72-897a-4012-9056-f098c2be4d4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:23.691379 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-afd92c72-897a-4012-9056-f098c2be4d4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:23.700513 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-afd92c72-897a-4012-9056-f098c2be4d4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:23.702075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-afd92c72-897a-4012-9056-f098c2be4d4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:23.703180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-afd92c72-897a-4012-9056-f098c2be4d4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1334 microversion: 2.20 time: 0.089753 Jul 21 06:35:23.703743 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 369/752] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:23 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:23.944121 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-25e9dfa4-fab4-4102-8bf3-91afc900d57d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:23.944909 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-25e9dfa4-fab4-4102-8bf3-91afc900d57d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:23.952388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-25e9dfa4-fab4-4102-8bf3-91afc900d57d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:23.952914 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-25e9dfa4-fab4-4102-8bf3-91afc900d57d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:23.953809 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-25e9dfa4-fab4-4102-8bf3-91afc900d57d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:23.954328 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-25e9dfa4-fab4-4102-8bf3-91afc900d57d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:24.126701 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-25e9dfa4-fab4-4102-8bf3-91afc900d57d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:24.134044 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-25e9dfa4-fab4-4102-8bf3-91afc900d57d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1319 microversion: 2.1 time: 0.194145 Jul 21 06:35:24.134782 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 384/753] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:23 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:24.720531 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b0497a7f-6459-4077-803b-8852fbed00d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:24.721303 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b0497a7f-6459-4077-803b-8852fbed00d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:24.728288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b0497a7f-6459-4077-803b-8852fbed00d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:24.728749 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b0497a7f-6459-4077-803b-8852fbed00d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:24.729579 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b0497a7f-6459-4077-803b-8852fbed00d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:24.730053 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b0497a7f-6459-4077-803b-8852fbed00d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:24.792857 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b0497a7f-6459-4077-803b-8852fbed00d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:24.801012 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b0497a7f-6459-4077-803b-8852fbed00d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:24.802563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b0497a7f-6459-4077-803b-8852fbed00d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:24.803668 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b0497a7f-6459-4077-803b-8852fbed00d5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1340 microversion: 2.20 time: 0.086985 Jul 21 06:35:24.804597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 370/754] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:24 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1340 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:25.151763 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e08b0e34-95f5-492e-8b1e-c8509d896631 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:25.152359 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e08b0e34-95f5-492e-8b1e-c8509d896631 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:25.158798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e08b0e34-95f5-492e-8b1e-c8509d896631 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:25.159272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e08b0e34-95f5-492e-8b1e-c8509d896631 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:25.160046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e08b0e34-95f5-492e-8b1e-c8509d896631 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:25.160473 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e08b0e34-95f5-492e-8b1e-c8509d896631 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:25.287134 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e08b0e34-95f5-492e-8b1e-c8509d896631 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:25.295655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e08b0e34-95f5-492e-8b1e-c8509d896631 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1506 microversion: 2.1 time: 0.148332 Jul 21 06:35:25.296213 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 385/755] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:25 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:25.313661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-68d1168a-a8e8-40a0-a88b-d5ea145493c7 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e49da76-1f0a-4a5c-89a6-aafc1497ec88", "device": "/dev/sdb"}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:25.315207 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-68d1168a-a8e8-40a0-a88b-d5ea145493c7 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:25.321277 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-68d1168a-a8e8-40a0-a88b-d5ea145493c7 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:25.321725 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-68d1168a-a8e8-40a0-a88b-d5ea145493c7 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:25.322542 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-68d1168a-a8e8-40a0-a88b-d5ea145493c7 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:25.322979 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-68d1168a-a8e8-40a0-a88b-d5ea145493c7 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:25.780628 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-68d1168a-a8e8-40a0-a88b-d5ea145493c7 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "POST /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.470773 Jul 21 06:35:25.781280 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 371/756] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:35:25 2022] POST /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394/os-volume_attachments => generated 194 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:35:25.822305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ca800275-f996-4905-97f4-62c46e43fdd7 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:25.823676 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ca800275-f996-4905-97f4-62c46e43fdd7 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:25.831544 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca800275-f996-4905-97f4-62c46e43fdd7 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:25.832227 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca800275-f996-4905-97f4-62c46e43fdd7 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:25.833261 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca800275-f996-4905-97f4-62c46e43fdd7 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:25.833918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca800275-f996-4905-97f4-62c46e43fdd7 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:25.906910 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ca800275-f996-4905-97f4-62c46e43fdd7 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:25.914840 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ca800275-f996-4905-97f4-62c46e43fdd7 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:25.916401 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ca800275-f996-4905-97f4-62c46e43fdd7 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:25.917568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ca800275-f996-4905-97f4-62c46e43fdd7 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1340 microversion: 2.20 time: 0.099159 Jul 21 06:35:25.918159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 386/757] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:25 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:26.509865 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-275549d1-43bc-4c27-8351-ce72246e51af tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:26.510482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-275549d1-43bc-4c27-8351-ce72246e51af tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:26.517480 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-275549d1-43bc-4c27-8351-ce72246e51af tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:26.517934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-275549d1-43bc-4c27-8351-ce72246e51af tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:26.518732 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-275549d1-43bc-4c27-8351-ce72246e51af tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:26.519178 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-275549d1-43bc-4c27-8351-ce72246e51af tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:26.600546 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-275549d1-43bc-4c27-8351-ce72246e51af tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lazy-loading 'services' on Instance uuid 6d312821-22fc-4f7a-9a04-88f677a66511 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:26.674614 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-275549d1-43bc-4c27-8351-ce72246e51af tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments/09f931a3-5e05-40f8-8ddc-108c279ad49d" status: 202 len: 0 microversion: 2.1 time: 0.168907 Jul 21 06:35:26.675743 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 372/758] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:35:26 2022] DELETE /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments/09f931a3-5e05-40f8-8ddc-108c279ad49d => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:35:26.684781 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-89f07c1b-fec9-4101-8bff-1202513fb35f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:26.686510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-89f07c1b-fec9-4101-8bff-1202513fb35f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:26.693599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-89f07c1b-fec9-4101-8bff-1202513fb35f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:26.694525 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-89f07c1b-fec9-4101-8bff-1202513fb35f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:26.695794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-89f07c1b-fec9-4101-8bff-1202513fb35f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:26.696667 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-89f07c1b-fec9-4101-8bff-1202513fb35f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:26.735306 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-89f07c1b-fec9-4101-8bff-1202513fb35f tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055018 Jul 21 06:35:26.735977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 387/759] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:35:26 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:26.937794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-72bd58ac-7330-4947-9925-beab19c39ee1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:26.938477 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-72bd58ac-7330-4947-9925-beab19c39ee1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:26.947146 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-5f42d238-fd24-4612-897a-f6ad8f15d4b6 req-b4214355-88a2-4925-bb6a-6dfe96f8ba86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ff60b2-b16b-481d-8396-016f9068bff1", "tag": "4aee29c5-9551-4f05-a973-a575a8c0fa54"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:26.976198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-5f42d238-fd24-4612-897a-f6ad8f15d4b6 req-b4214355-88a2-4925-bb6a-6dfe96f8ba86 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:26.981622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-72bd58ac-7330-4947-9925-beab19c39ee1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:26.982101 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-72bd58ac-7330-4947-9925-beab19c39ee1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:26.982881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-72bd58ac-7330-4947-9925-beab19c39ee1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:26.983315 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-72bd58ac-7330-4947-9925-beab19c39ee1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:26.985708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-5f42d238-fd24-4612-897a-f6ad8f15d4b6 req-b4214355-88a2-4925-bb6a-6dfe96f8ba86 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:26.999587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-5f42d238-fd24-4612-897a-f6ad8f15d4b6 req-b4214355-88a2-4925-bb6a-6dfe96f8ba86 service nova] Creating event network-changed:4aee29c5-9551-4f05-a973-a575a8c0fa54 for instance d6ff60b2-b16b-481d-8396-016f9068bff1 on hv-cinder-85031 Jul 21 06:35:27.004233 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-5f42d238-fd24-4612-897a-f6ad8f15d4b6 req-b4214355-88a2-4925-bb6a-6dfe96f8ba86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062490 Jul 21 06:35:27.005026 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 388/760] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:27.373097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-72bd58ac-7330-4947-9925-beab19c39ee1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:27.376631 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:27.381884 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-72bd58ac-7330-4947-9925-beab19c39ee1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:27.383406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-72bd58ac-7330-4947-9925-beab19c39ee1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:27.384505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-72bd58ac-7330-4947-9925-beab19c39ee1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1407 microversion: 2.20 time: 0.451881 Jul 21 06:35:27.385060 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 373/761] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:26 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:27.747738 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-96ea45bd-637b-47ad-a9fb-8d4576d019da tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:27.748731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-96ea45bd-637b-47ad-a9fb-8d4576d019da tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:27.755128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-96ea45bd-637b-47ad-a9fb-8d4576d019da tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:27.755610 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-96ea45bd-637b-47ad-a9fb-8d4576d019da tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:27.756372 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-96ea45bd-637b-47ad-a9fb-8d4576d019da tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:27.756807 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-96ea45bd-637b-47ad-a9fb-8d4576d019da tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:27.787040 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-96ea45bd-637b-47ad-a9fb-8d4576d019da tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Jul 21 06:35:27.787595 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 389/762] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:35:27 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:28.403434 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6a22df47-7810-45a7-b469-e43403df31c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:28.403974 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6a22df47-7810-45a7-b469-e43403df31c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:28.411839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a22df47-7810-45a7-b469-e43403df31c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:28.412287 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a22df47-7810-45a7-b469-e43403df31c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:28.413051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a22df47-7810-45a7-b469-e43403df31c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:28.413494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a22df47-7810-45a7-b469-e43403df31c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:28.551620 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6a22df47-7810-45a7-b469-e43403df31c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:28.560738 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6a22df47-7810-45a7-b469-e43403df31c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:28.562432 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6a22df47-7810-45a7-b469-e43403df31c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:28.563618 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6a22df47-7810-45a7-b469-e43403df31c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1407 microversion: 2.20 time: 0.164660 Jul 21 06:35:28.564297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 374/763] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:28 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:28.799495 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6aa0c0da-ef04-42ee-a86e-0543e4a8b4b4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:28.800416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6aa0c0da-ef04-42ee-a86e-0543e4a8b4b4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:28.807109 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6aa0c0da-ef04-42ee-a86e-0543e4a8b4b4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:28.808206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6aa0c0da-ef04-42ee-a86e-0543e4a8b4b4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:28.809135 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6aa0c0da-ef04-42ee-a86e-0543e4a8b4b4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:28.809570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6aa0c0da-ef04-42ee-a86e-0543e4a8b4b4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:28.813474 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:28.838647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6aa0c0da-ef04-42ee-a86e-0543e4a8b4b4 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043314 Jul 21 06:35:28.839251 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 390/764] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:35:28 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:29.582357 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-dac13798-aecc-4cfd-a9f5-90fa9450e1c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:29.583168 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-dac13798-aecc-4cfd-a9f5-90fa9450e1c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:29.593221 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dac13798-aecc-4cfd-a9f5-90fa9450e1c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:29.593672 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dac13798-aecc-4cfd-a9f5-90fa9450e1c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:29.594637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dac13798-aecc-4cfd-a9f5-90fa9450e1c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:29.595218 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-dac13798-aecc-4cfd-a9f5-90fa9450e1c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:29.704906 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6e157595-1f42-418f-ab9b-16559bedc911 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:29.705865 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6e157595-1f42-418f-ab9b-16559bedc911 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:29.711918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6e157595-1f42-418f-ab9b-16559bedc911 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:29.712382 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6e157595-1f42-418f-ab9b-16559bedc911 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:29.713152 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6e157595-1f42-418f-ab9b-16559bedc911 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:29.713596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6e157595-1f42-418f-ab9b-16559bedc911 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:29.727374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-dac13798-aecc-4cfd-a9f5-90fa9450e1c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:29.735457 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-dac13798-aecc-4cfd-a9f5-90fa9450e1c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:29.736952 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-dac13798-aecc-4cfd-a9f5-90fa9450e1c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:29.738078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-dac13798-aecc-4cfd-a9f5-90fa9450e1c8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1407 microversion: 2.20 time: 0.159727 Jul 21 06:35:29.738650 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 375/765] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:29 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:29.742958 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6e157595-1f42-418f-ab9b-16559bedc911 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041979 Jul 21 06:35:29.743516 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 391/766] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:35:29 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 06:35:29.800918 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ab314dca-9850-4d69-b334-f71e70dc4d82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:29.801430 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ab314dca-9850-4d69-b334-f71e70dc4d82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:29.808086 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ab314dca-9850-4d69-b334-f71e70dc4d82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:29.808480 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ab314dca-9850-4d69-b334-f71e70dc4d82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:29.809243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ab314dca-9850-4d69-b334-f71e70dc4d82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:29.809676 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ab314dca-9850-4d69-b334-f71e70dc4d82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:29.834668 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ab314dca-9850-4d69-b334-f71e70dc4d82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:35:29.850390 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9a6cce29-1292-444c-94c5-56e0a2b77061 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:29.851310 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9a6cce29-1292-444c-94c5-56e0a2b77061 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:29.857656 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9a6cce29-1292-444c-94c5-56e0a2b77061 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:29.858144 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9a6cce29-1292-444c-94c5-56e0a2b77061 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:29.858907 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9a6cce29-1292-444c-94c5-56e0a2b77061 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:29.859343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9a6cce29-1292-444c-94c5-56e0a2b77061 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:29.889067 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9a6cce29-1292-444c-94c5-56e0a2b77061 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042606 Jul 21 06:35:29.889643 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 392/767] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:35:29 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:35:29.913286 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ab314dca-9850-4d69-b334-f71e70dc4d82 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 204 len: 0 microversion: 2.1 time: 0.115625 Jul 21 06:35:29.913875 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 376/768] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:35:29 2022] DELETE /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:35:29.922223 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b138e8e3-c3f4-4609-9aff-dd8e475272de tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:29.922841 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b138e8e3-c3f4-4609-9aff-dd8e475272de tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:29.928797 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b138e8e3-c3f4-4609-9aff-dd8e475272de tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:29.929250 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b138e8e3-c3f4-4609-9aff-dd8e475272de tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:29.930037 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b138e8e3-c3f4-4609-9aff-dd8e475272de tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:29.930481 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b138e8e3-c3f4-4609-9aff-dd8e475272de tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:30.066039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b138e8e3-c3f4-4609-9aff-dd8e475272de tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:30.074107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b138e8e3-c3f4-4609-9aff-dd8e475272de tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1672 microversion: 2.1 time: 0.155415 Jul 21 06:35:30.074786 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 393/769] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:29 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:30.756647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2636831d-83d6-4cbc-b2de-5ec430e3bdbe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:30.757341 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2636831d-83d6-4cbc-b2de-5ec430e3bdbe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:30.764282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2636831d-83d6-4cbc-b2de-5ec430e3bdbe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:30.764727 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2636831d-83d6-4cbc-b2de-5ec430e3bdbe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:30.765871 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2636831d-83d6-4cbc-b2de-5ec430e3bdbe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:30.766338 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2636831d-83d6-4cbc-b2de-5ec430e3bdbe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:30.902382 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-adf29d69-06a4-4cb0-91a2-cbabc3035e5b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:30.902888 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2636831d-83d6-4cbc-b2de-5ec430e3bdbe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:30.903654 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-adf29d69-06a4-4cb0-91a2-cbabc3035e5b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:30.910456 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-adf29d69-06a4-4cb0-91a2-cbabc3035e5b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:30.911050 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-adf29d69-06a4-4cb0-91a2-cbabc3035e5b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:30.911763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2636831d-83d6-4cbc-b2de-5ec430e3bdbe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:30.912000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-adf29d69-06a4-4cb0-91a2-cbabc3035e5b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:30.912611 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-adf29d69-06a4-4cb0-91a2-cbabc3035e5b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:30.913548 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2636831d-83d6-4cbc-b2de-5ec430e3bdbe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:30.914730 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2636831d-83d6-4cbc-b2de-5ec430e3bdbe tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1407 microversion: 2.20 time: 0.162322 Jul 21 06:35:30.915564 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 377/770] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:30 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:30.945331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-adf29d69-06a4-4cb0-91a2-cbabc3035e5b tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048310 Jul 21 06:35:30.945901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 394/771] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:35:30 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:31.093732 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-97b1a7a5-8245-4041-8065-8930ab656e52 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:31.094387 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-97b1a7a5-8245-4041-8065-8930ab656e52 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:31.100954 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-97b1a7a5-8245-4041-8065-8930ab656e52 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:31.101439 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-97b1a7a5-8245-4041-8065-8930ab656e52 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:31.102246 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-97b1a7a5-8245-4041-8065-8930ab656e52 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:31.102679 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-97b1a7a5-8245-4041-8065-8930ab656e52 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:31.234815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-97b1a7a5-8245-4041-8065-8930ab656e52 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:31.242559 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-97b1a7a5-8245-4041-8065-8930ab656e52 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1672 microversion: 2.1 time: 0.154055 Jul 21 06:35:31.243299 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 378/772] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:31 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:31.934663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d9962faf-8130-401d-9b24-0674e4443c19 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:31.935220 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d9962faf-8130-401d-9b24-0674e4443c19 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:31.941794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d9962faf-8130-401d-9b24-0674e4443c19 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:31.942286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d9962faf-8130-401d-9b24-0674e4443c19 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:31.943061 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d9962faf-8130-401d-9b24-0674e4443c19 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:31.943506 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d9962faf-8130-401d-9b24-0674e4443c19 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:31.956589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f739ad68-2414-41ed-b3a1-1ba9ee993307 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:31.957585 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f739ad68-2414-41ed-b3a1-1ba9ee993307 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:31.964406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f739ad68-2414-41ed-b3a1-1ba9ee993307 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:31.964858 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f739ad68-2414-41ed-b3a1-1ba9ee993307 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:31.965673 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f739ad68-2414-41ed-b3a1-1ba9ee993307 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:31.966160 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f739ad68-2414-41ed-b3a1-1ba9ee993307 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:31.998464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f739ad68-2414-41ed-b3a1-1ba9ee993307 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045609 Jul 21 06:35:31.999040 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 379/773] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:35:31 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:35:32.077222 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d9962faf-8130-401d-9b24-0674e4443c19 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:32.085206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d9962faf-8130-401d-9b24-0674e4443c19 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:32.086772 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d9962faf-8130-401d-9b24-0674e4443c19 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:32.087884 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d9962faf-8130-401d-9b24-0674e4443c19 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1407 microversion: 2.20 time: 0.157853 Jul 21 06:35:32.088450 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 395/774] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:31 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:32.260388 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c1823803-3f9a-4d70-a4ee-e1de9cd03aab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:32.261200 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c1823803-3f9a-4d70-a4ee-e1de9cd03aab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:32.267240 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c1823803-3f9a-4d70-a4ee-e1de9cd03aab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:32.267698 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c1823803-3f9a-4d70-a4ee-e1de9cd03aab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:32.268464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c1823803-3f9a-4d70-a4ee-e1de9cd03aab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:32.268906 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c1823803-3f9a-4d70-a4ee-e1de9cd03aab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:32.394965 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c1823803-3f9a-4d70-a4ee-e1de9cd03aab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:32.403426 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c1823803-3f9a-4d70-a4ee-e1de9cd03aab tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1672 microversion: 2.1 time: 0.146928 Jul 21 06:35:32.404006 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 380/775] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:32 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:32.997210 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-cae94e38-0cd3-4a3e-84ff-fe0b87ce5c10 req-ae24e4f7-f805-4168-a1eb-b2c0fdb830ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ff60b2-b16b-481d-8396-016f9068bff1", "name": "network-vif-plugged", "status": "completed", "tag": "4aee29c5-9551-4f05-a973-a575a8c0fa54"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:33.000631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:33.001295 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=6 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:33.009970 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-cae94e38-0cd3-4a3e-84ff-fe0b87ce5c10 req-ae24e4f7-f805-4168-a1eb-b2c0fdb830ec service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:33.010124 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a8312c22-3bc6-492b-bf78-d7d79041682d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:33.012487 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-cae94e38-0cd3-4a3e-84ff-fe0b87ce5c10 req-ae24e4f7-f805-4168-a1eb-b2c0fdb830ec service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:33.012591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a8312c22-3bc6-492b-bf78-d7d79041682d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:33.014326 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=14 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:33.019120 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a8312c22-3bc6-492b-bf78-d7d79041682d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:33.019576 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a8312c22-3bc6-492b-bf78-d7d79041682d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:33.020356 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a8312c22-3bc6-492b-bf78-d7d79041682d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:33.020800 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a8312c22-3bc6-492b-bf78-d7d79041682d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:33.025263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-cae94e38-0cd3-4a3e-84ff-fe0b87ce5c10 req-ae24e4f7-f805-4168-a1eb-b2c0fdb830ec service nova] Creating event network-vif-plugged:4aee29c5-9551-4f05-a973-a575a8c0fa54 for instance d6ff60b2-b16b-481d-8396-016f9068bff1 on hv-cinder-85031 Jul 21 06:35:33.031935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-cae94e38-0cd3-4a3e-84ff-fe0b87ce5c10 req-ae24e4f7-f805-4168-a1eb-b2c0fdb830ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038059 Jul 21 06:35:33.032557 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 396/776] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:33.051861 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a8312c22-3bc6-492b-bf78-d7d79041682d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Jul 21 06:35:33.052698 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 381/777] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:35:33 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:35:33.107201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9ecbace0-20ac-47a7-8563-19e549589562 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:33.107901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9ecbace0-20ac-47a7-8563-19e549589562 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:33.114114 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9ecbace0-20ac-47a7-8563-19e549589562 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:33.114567 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9ecbace0-20ac-47a7-8563-19e549589562 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:33.115326 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9ecbace0-20ac-47a7-8563-19e549589562 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:33.115762 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9ecbace0-20ac-47a7-8563-19e549589562 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:33.305117 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9ecbace0-20ac-47a7-8563-19e549589562 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:33.318777 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9ecbace0-20ac-47a7-8563-19e549589562 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:33.320319 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9ecbace0-20ac-47a7-8563-19e549589562 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:33.321521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9ecbace0-20ac-47a7-8563-19e549589562 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1407 microversion: 2.20 time: 0.219348 Jul 21 06:35:33.322154 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 397/778] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:33 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:33.420557 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4d5c5c75-054d-462b-90b1-b728058a4679 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:33.421073 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4d5c5c75-054d-462b-90b1-b728058a4679 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:33.427437 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d5c5c75-054d-462b-90b1-b728058a4679 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:33.427899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d5c5c75-054d-462b-90b1-b728058a4679 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:33.428950 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d5c5c75-054d-462b-90b1-b728058a4679 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:33.429397 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d5c5c75-054d-462b-90b1-b728058a4679 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:33.568879 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4d5c5c75-054d-462b-90b1-b728058a4679 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:33.576764 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4d5c5c75-054d-462b-90b1-b728058a4679 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1672 microversion: 2.1 time: 0.160711 Jul 21 06:35:33.577339 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 382/779] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:33 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:34.064648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-93b89202-1a51-44ac-84c0-dfb955c6411c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:34.066274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-93b89202-1a51-44ac-84c0-dfb955c6411c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:34.073828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-93b89202-1a51-44ac-84c0-dfb955c6411c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:34.074342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-93b89202-1a51-44ac-84c0-dfb955c6411c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:34.075297 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-93b89202-1a51-44ac-84c0-dfb955c6411c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:34.075725 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-93b89202-1a51-44ac-84c0-dfb955c6411c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:34.106197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-93b89202-1a51-44ac-84c0-dfb955c6411c tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Jul 21 06:35:34.106772 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 398/780] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:35:34 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:34.305244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-27d468c9-9672-452e-b96b-9c5183d41aac req-108c24c3-62d8-43a2-a5ab-eb4f4b4c240e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7788e87-32b8-4250-bae6-b666d958ab97", "name": "network-vif-deleted", "tag": "64c03855-c1db-478e-916b-e86e4f9e9bdc"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:34.322375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-27d468c9-9672-452e-b96b-9c5183d41aac req-108c24c3-62d8-43a2-a5ab-eb4f4b4c240e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:34.322830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-27d468c9-9672-452e-b96b-9c5183d41aac req-108c24c3-62d8-43a2-a5ab-eb4f4b4c240e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:34.336725 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-27d468c9-9672-452e-b96b-9c5183d41aac req-108c24c3-62d8-43a2-a5ab-eb4f4b4c240e service nova] Creating event network-vif-deleted:64c03855-c1db-478e-916b-e86e4f9e9bdc for instance e7788e87-32b8-4250-bae6-b666d958ab97 on hv-cinder-85031 Jul 21 06:35:34.341318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-860bd815-ce7c-4a27-a4ed-b420e64fa586 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:34.341931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-860bd815-ce7c-4a27-a4ed-b420e64fa586 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:34.342098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-27d468c9-9672-452e-b96b-9c5183d41aac req-108c24c3-62d8-43a2-a5ab-eb4f4b4c240e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041323 Jul 21 06:35:34.343543 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 383/781] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:34.354028 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-860bd815-ce7c-4a27-a4ed-b420e64fa586 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:34.355178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-860bd815-ce7c-4a27-a4ed-b420e64fa586 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:34.356771 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-860bd815-ce7c-4a27-a4ed-b420e64fa586 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:34.357739 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-860bd815-ce7c-4a27-a4ed-b420e64fa586 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:34.517712 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-860bd815-ce7c-4a27-a4ed-b420e64fa586 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:34.530268 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-860bd815-ce7c-4a27-a4ed-b420e64fa586 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:34.531913 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-860bd815-ce7c-4a27-a4ed-b420e64fa586 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:34.533548 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-860bd815-ce7c-4a27-a4ed-b420e64fa586 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1407 microversion: 2.20 time: 0.196718 Jul 21 06:35:34.534416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 399/782] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:34 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:35:34.595087 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3263bcce-f6aa-4aca-8f87-078dcad611b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:34.595906 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3263bcce-f6aa-4aca-8f87-078dcad611b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:34.603800 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3263bcce-f6aa-4aca-8f87-078dcad611b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:34.604354 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3263bcce-f6aa-4aca-8f87-078dcad611b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:34.605605 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3263bcce-f6aa-4aca-8f87-078dcad611b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:34.606557 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3263bcce-f6aa-4aca-8f87-078dcad611b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:34.677280 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3263bcce-f6aa-4aca-8f87-078dcad611b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:34.685657 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3263bcce-f6aa-4aca-8f87-078dcad611b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1606 microversion: 2.1 time: 0.095150 Jul 21 06:35:34.686262 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 384/783] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:34 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:35.117810 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-389058d5-3bb0-4161-98eb-0d10e74c1bc0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:35.118786 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-389058d5-3bb0-4161-98eb-0d10e74c1bc0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:35.126138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-389058d5-3bb0-4161-98eb-0d10e74c1bc0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.126588 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-389058d5-3bb0-4161-98eb-0d10e74c1bc0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.127358 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-389058d5-3bb0-4161-98eb-0d10e74c1bc0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.127792 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-389058d5-3bb0-4161-98eb-0d10e74c1bc0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.157644 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-389058d5-3bb0-4161-98eb-0d10e74c1bc0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043771 Jul 21 06:35:35.158247 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 400/784] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:35:35 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:35:35.234527 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-49348fe6-ebca-40ce-a122-dff7c1e2e966 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:35.237751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-49348fe6-ebca-40ce-a122-dff7c1e2e966 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:35.239931 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:35.246375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-49348fe6-ebca-40ce-a122-dff7c1e2e966 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.246923 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-49348fe6-ebca-40ce-a122-dff7c1e2e966 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.247761 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-49348fe6-ebca-40ce-a122-dff7c1e2e966 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.248268 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-49348fe6-ebca-40ce-a122-dff7c1e2e966 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.275476 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-49348fe6-ebca-40ce-a122-dff7c1e2e966 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:35:35.352615 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-49348fe6-ebca-40ce-a122-dff7c1e2e966 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 204 len: 0 microversion: 2.1 time: 0.121625 Jul 21 06:35:35.353267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 385/785] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:35:35 2022] DELETE /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:35:35.361326 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-03765822-b36a-43c3-af08-8368401e8c27 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:35.362052 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-03765822-b36a-43c3-af08-8368401e8c27 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:35.367956 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-03765822-b36a-43c3-af08-8368401e8c27 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.368757 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-03765822-b36a-43c3-af08-8368401e8c27 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.369579 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-03765822-b36a-43c3-af08-8368401e8c27 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.371300 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-03765822-b36a-43c3-af08-8368401e8c27 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.508674 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-03765822-b36a-43c3-af08-8368401e8c27 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:35.516564 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-03765822-b36a-43c3-af08-8368401e8c27 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1689 microversion: 2.1 time: 0.159168 Jul 21 06:35:35.517126 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 401/786] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:35 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:35.552208 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ff5041f9-3572-474b-9983-b2cb04cbc3b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:35.552908 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ff5041f9-3572-474b-9983-b2cb04cbc3b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:35.559186 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ff5041f9-3572-474b-9983-b2cb04cbc3b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.559667 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ff5041f9-3572-474b-9983-b2cb04cbc3b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.560423 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ff5041f9-3572-474b-9983-b2cb04cbc3b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.560863 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ff5041f9-3572-474b-9983-b2cb04cbc3b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.692807 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ff5041f9-3572-474b-9983-b2cb04cbc3b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:35.701344 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ff5041f9-3572-474b-9983-b2cb04cbc3b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:35.701518 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:35.702090 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:35.702898 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ff5041f9-3572-474b-9983-b2cb04cbc3b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:35.704023 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ff5041f9-3572-474b-9983-b2cb04cbc3b1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1407 microversion: 2.20 time: 0.156028 Jul 21 06:35:35.704595 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 386/787] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:35 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:35.708078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.708532 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.709295 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.709734 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.742033 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:35.742482 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:35.742927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lazy-loading 'fault' on Instance uuid e7788e87-32b8-4250-bae6-b666d958ab97 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:35.787397 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:35.795405 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d432f4b9-e24e-4e5d-8285-8e70e423e985 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1328 microversion: 2.1 time: 0.097764 Jul 21 06:35:35.795972 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 402/788] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:35 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:36.534537 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3deb76eb-a63e-4fe3-8827-0a60eddbd0a3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:36.535165 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3deb76eb-a63e-4fe3-8827-0a60eddbd0a3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:36.541666 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3deb76eb-a63e-4fe3-8827-0a60eddbd0a3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:36.542365 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3deb76eb-a63e-4fe3-8827-0a60eddbd0a3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:36.543228 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3deb76eb-a63e-4fe3-8827-0a60eddbd0a3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:36.543673 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3deb76eb-a63e-4fe3-8827-0a60eddbd0a3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:36.673743 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3deb76eb-a63e-4fe3-8827-0a60eddbd0a3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:36.677236 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:36.682018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3deb76eb-a63e-4fe3-8827-0a60eddbd0a3 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1689 microversion: 2.1 time: 0.151312 Jul 21 06:35:36.683094 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 387/789] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:36 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:36.779541 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-73b5142a-f76a-492e-8a5c-7572a3a9f7f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:36.780162 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-73b5142a-f76a-492e-8a5c-7572a3a9f7f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:36.786528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73b5142a-f76a-492e-8a5c-7572a3a9f7f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:36.786981 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73b5142a-f76a-492e-8a5c-7572a3a9f7f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:36.787747 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73b5142a-f76a-492e-8a5c-7572a3a9f7f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:36.788188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73b5142a-f76a-492e-8a5c-7572a3a9f7f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:36.813007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:36.813623 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:36.820503 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:36.820999 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:36.821925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:36.822484 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:36.854545 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:36.854997 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:36.855449 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lazy-loading 'fault' on Instance uuid e7788e87-32b8-4250-bae6-b666d958ab97 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:36.914393 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:36.922329 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7d4d660e-1634-4025-bb9d-d6edc0e0f3b9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1328 microversion: 2.1 time: 0.114690 Jul 21 06:35:36.923032 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 388/790] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:36 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:36.947421 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-73b5142a-f76a-492e-8a5c-7572a3a9f7f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:36.956528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-73b5142a-f76a-492e-8a5c-7572a3a9f7f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:36.958047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-73b5142a-f76a-492e-8a5c-7572a3a9f7f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:36.959177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-73b5142a-f76a-492e-8a5c-7572a3a9f7f3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1407 microversion: 2.20 time: 0.241081 Jul 21 06:35:36.959753 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 403/791] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:36 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:35:37.700194 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-93c86f2f-b23d-41b0-aed8-6f45cf058af2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:37.700807 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-93c86f2f-b23d-41b0-aed8-6f45cf058af2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:37.707407 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-93c86f2f-b23d-41b0-aed8-6f45cf058af2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:37.707858 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-93c86f2f-b23d-41b0-aed8-6f45cf058af2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:37.708739 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-93c86f2f-b23d-41b0-aed8-6f45cf058af2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:37.709185 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-93c86f2f-b23d-41b0-aed8-6f45cf058af2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:37.845456 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-93c86f2f-b23d-41b0-aed8-6f45cf058af2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:37.852970 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-93c86f2f-b23d-41b0-aed8-6f45cf058af2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1689 microversion: 2.1 time: 0.157549 Jul 21 06:35:37.853548 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 389/792] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:37 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:37.939971 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:37.940558 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:37.946998 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:37.947455 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:37.948220 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:37.948663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:37.978356 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-56aa8051-095f-44c2-aa8a-40dbc59a4f22 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:37.978969 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-56aa8051-095f-44c2-aa8a-40dbc59a4f22 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:37.985502 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-56aa8051-095f-44c2-aa8a-40dbc59a4f22 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:37.986113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-56aa8051-095f-44c2-aa8a-40dbc59a4f22 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:37.986886 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-56aa8051-095f-44c2-aa8a-40dbc59a4f22 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:37.987328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-56aa8051-095f-44c2-aa8a-40dbc59a4f22 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:37.988686 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:37.989143 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:37.989598 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lazy-loading 'fault' on Instance uuid e7788e87-32b8-4250-bae6-b666d958ab97 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:38.036609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:38.045477 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-71202153-9005-43f7-9551-23f54f303476 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1328 microversion: 2.1 time: 0.109450 Jul 21 06:35:38.055082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 404/793] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:37 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:38.267122 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-56aa8051-095f-44c2-aa8a-40dbc59a4f22 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:38.275172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-56aa8051-095f-44c2-aa8a-40dbc59a4f22 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:38.277209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-56aa8051-095f-44c2-aa8a-40dbc59a4f22 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:38.278535 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-56aa8051-095f-44c2-aa8a-40dbc59a4f22 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1599 microversion: 2.20 time: 0.304234 Jul 21 06:35:38.279102 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 390/794] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:35:37 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1599 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:35:38.296552 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d1bb7146-c9e9-458a-99bd-1dad45837b27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:38.297044 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d1bb7146-c9e9-458a-99bd-1dad45837b27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:38.303195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d1bb7146-c9e9-458a-99bd-1dad45837b27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:38.303644 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d1bb7146-c9e9-458a-99bd-1dad45837b27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:38.304435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d1bb7146-c9e9-458a-99bd-1dad45837b27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:38.304876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d1bb7146-c9e9-458a-99bd-1dad45837b27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:38.381115 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d1bb7146-c9e9-458a-99bd-1dad45837b27 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089141 Jul 21 06:35:38.381708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 405/795] 10.222.0.42 () {60 vars in 1315 bytes} [Thu Jul 21 06:35:38 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:35:38.873268 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-350c55f5-3f79-4834-b448-dadaab6cf5aa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:38.874559 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-350c55f5-3f79-4834-b448-dadaab6cf5aa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:38.881167 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-350c55f5-3f79-4834-b448-dadaab6cf5aa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:38.882349 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-350c55f5-3f79-4834-b448-dadaab6cf5aa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:38.883733 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-350c55f5-3f79-4834-b448-dadaab6cf5aa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:38.884842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-350c55f5-3f79-4834-b448-dadaab6cf5aa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:39.063343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:39.063960 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:39.070181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:39.070633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:39.071396 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:39.071828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:39.103323 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:39.103767 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:39.104213 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lazy-loading 'fault' on Instance uuid e7788e87-32b8-4250-bae6-b666d958ab97 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:39.139801 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-350c55f5-3f79-4834-b448-dadaab6cf5aa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:39.147330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-350c55f5-3f79-4834-b448-dadaab6cf5aa tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1689 microversion: 2.1 time: 0.281301 Jul 21 06:35:39.147981 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 391/796] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:38 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1689 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:39.162461 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:39.165974 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:39.171332 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b23f75fa-b754-44f2-862e-9d8864d5d870 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1328 microversion: 2.1 time: 0.111894 Jul 21 06:35:39.171908 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 406/797] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:39 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1328 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:39.428992 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-9ad2edae-4a76-4a67-8800-63b84a6b4f35 req-e6826084-5680-4e6e-86ad-9e5f017c14f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ff60b2-b16b-481d-8396-016f9068bff1", "tag": "4aee29c5-9551-4f05-a973-a575a8c0fa54"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:39.437255 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-9ad2edae-4a76-4a67-8800-63b84a6b4f35 req-e6826084-5680-4e6e-86ad-9e5f017c14f8 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:39.437694 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-9ad2edae-4a76-4a67-8800-63b84a6b4f35 req-e6826084-5680-4e6e-86ad-9e5f017c14f8 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:39.448223 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-9ad2edae-4a76-4a67-8800-63b84a6b4f35 req-e6826084-5680-4e6e-86ad-9e5f017c14f8 service nova] Creating event network-changed:4aee29c5-9551-4f05-a973-a575a8c0fa54 for instance d6ff60b2-b16b-481d-8396-016f9068bff1 on hv-cinder-85031 Jul 21 06:35:39.453803 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-9ad2edae-4a76-4a67-8800-63b84a6b4f35 req-e6826084-5680-4e6e-86ad-9e5f017c14f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028442 Jul 21 06:35:39.454603 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 392/798] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:40.165022 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-52f0cec4-2f7c-46fb-81e7-030c85c12aa1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:40.165565 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-52f0cec4-2f7c-46fb-81e7-030c85c12aa1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:40.172814 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-52f0cec4-2f7c-46fb-81e7-030c85c12aa1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:40.173268 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-52f0cec4-2f7c-46fb-81e7-030c85c12aa1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:40.174056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-52f0cec4-2f7c-46fb-81e7-030c85c12aa1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:40.174538 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-52f0cec4-2f7c-46fb-81e7-030c85c12aa1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:40.190187 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:40.191638 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:40.197848 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:40.198342 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:40.199166 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:40.199742 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:40.237329 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:40.237925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:40.238550 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lazy-loading 'fault' on Instance uuid e7788e87-32b8-4250-bae6-b666d958ab97 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:40.292409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:40.300352 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0a1c6f60-5243-4c7b-a5fe-0b0aedc32ff8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1328 microversion: 2.1 time: 0.115255 Jul 21 06:35:40.300922 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 393/799] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:40 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:40.335547 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-52f0cec4-2f7c-46fb-81e7-030c85c12aa1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:40.343833 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-52f0cec4-2f7c-46fb-81e7-030c85c12aa1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1689 microversion: 2.1 time: 0.183108 Jul 21 06:35:40.344412 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 407/800] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:40 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:41.318541 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:41.319154 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:41.325748 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:41.326226 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:41.326987 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:41.327535 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:41.359204 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:41.359660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:41.360115 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lazy-loading 'fault' on Instance uuid e7788e87-32b8-4250-bae6-b666d958ab97 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:41.361550 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2224bcd5-35bf-48aa-b7d4-2f3d029b8924 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:41.362200 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2224bcd5-35bf-48aa-b7d4-2f3d029b8924 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:41.368684 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2224bcd5-35bf-48aa-b7d4-2f3d029b8924 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:41.370413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2224bcd5-35bf-48aa-b7d4-2f3d029b8924 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:41.371822 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2224bcd5-35bf-48aa-b7d4-2f3d029b8924 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:41.372271 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2224bcd5-35bf-48aa-b7d4-2f3d029b8924 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:41.399901 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:41.408124 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2907e844-3bda-4482-83fa-0410880ae35e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1328 microversion: 2.1 time: 0.093554 Jul 21 06:35:41.408693 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 394/801] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:41 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:41.503174 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2224bcd5-35bf-48aa-b7d4-2f3d029b8924 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:41.510642 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2224bcd5-35bf-48aa-b7d4-2f3d029b8924 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1689 microversion: 2.1 time: 0.152863 Jul 21 06:35:41.511205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 408/802] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:41 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:42.424779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:42.425395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:42.431931 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:42.432387 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:42.433152 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:42.434420 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:42.464202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:42.464916 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:42.465202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lazy-loading 'fault' on Instance uuid e7788e87-32b8-4250-bae6-b666d958ab97 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:42.505301 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:42.512740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-369b770d-421e-4ccb-b6ef-4598600249c8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 200 len: 1328 microversion: 2.1 time: 0.091851 Jul 21 06:35:42.513273 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 395/803] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:42 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 1328 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:42.529219 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-15e004e8-99c4-4617-a311-f489a2eaab35 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:42.529831 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-15e004e8-99c4-4617-a311-f489a2eaab35 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:42.536179 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-15e004e8-99c4-4617-a311-f489a2eaab35 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:42.536620 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-15e004e8-99c4-4617-a311-f489a2eaab35 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:42.537376 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-15e004e8-99c4-4617-a311-f489a2eaab35 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:42.537811 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-15e004e8-99c4-4617-a311-f489a2eaab35 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:42.666792 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-15e004e8-99c4-4617-a311-f489a2eaab35 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:42.674434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-15e004e8-99c4-4617-a311-f489a2eaab35 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1689 microversion: 2.1 time: 0.149877 Jul 21 06:35:42.675002 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 409/804] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:42 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:43.529583 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c1822f2a-5bee-402a-817b-a85f97c4239c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:43.530270 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c1822f2a-5bee-402a-817b-a85f97c4239c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:43.536873 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c1822f2a-5bee-402a-817b-a85f97c4239c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:43.537325 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c1822f2a-5bee-402a-817b-a85f97c4239c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:43.538119 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c1822f2a-5bee-402a-817b-a85f97c4239c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:43.538559 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c1822f2a-5bee-402a-817b-a85f97c4239c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:43.552564 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-c1822f2a-5bee-402a-817b-a85f97c4239c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] HTTP exception thrown: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c1822f2a-5bee-402a-817b-a85f97c4239c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Request method failure captured: Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 HTTP/1.1 Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKCcqaJBeB54FqXGaKKur-nfreQlHLohIqNdAugUhSQWq-xZokTWqQyBAuFpjKLZATcAoXRZvXdX24tAeEE1pIqTT7udK3AGpgcs4K7otiLAHxAAC5VH6BryWRz4yGA0UbhT4ure-BanWjUXr-WbBethAmMBV2bggPJ90DadrEzVh0 Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:35:43.554300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2843a54fec340e19485e7b821fc071a"}]}] Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 8561734cf36e47b5ab2d7242076437ff Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:35:43.555830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': 'e7788e87-32b8-4250-bae6-b666d958ab97'} Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:35:43.556622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:35:43.557880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:43.559196 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c1822f2a-5bee-402a-817b-a85f97c4239c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Returning 404 to user: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:35:43.559196 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c1822f2a-5bee-402a-817b-a85f97c4239c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 404 len: 111 microversion: 2.1 time: 0.030721 Jul 21 06:35:43.559196 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 396/805] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:43 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:35:43.564842 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-412f1066-2619-4ec1-a2d3-6584c3f19004 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '.version_select at 0x7f9327a3c040>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:43.570514 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:43.583447 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-412f1066-2619-4ec1-a2d3-6584c3f19004 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109656386" status: 202 len: 0 microversion: 2.1 time: 0.022339 Jul 21 06:35:43.584022 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 410/806] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jul 21 06:35:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109656386 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:35:43.692119 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-99594349-205e-497a-bada-f910d350c73d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:43.693180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-99594349-205e-497a-bada-f910d350c73d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:43.700127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-99594349-205e-497a-bada-f910d350c73d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:43.700657 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-99594349-205e-497a-bada-f910d350c73d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:43.701755 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-99594349-205e-497a-bada-f910d350c73d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:43.702234 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-99594349-205e-497a-bada-f910d350c73d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:43.978346 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-99594349-205e-497a-bada-f910d350c73d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:43.988244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-99594349-205e-497a-bada-f910d350c73d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 200 len: 1689 microversion: 2.1 time: 0.300063 Jul 21 06:35:43.998541 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 397/807] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:43 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 1689 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:44.216988 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-8b7c758a-a30e-4dac-b615-412c39539918 req-184d3e34-3160-49dd-a320-b55f36558ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d312821-22fc-4f7a-9a04-88f677a66511", "name": "network-vif-deleted", "tag": "f6cc1e71-5824-4e10-98c9-72b30b663270"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:44.231602 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-8b7c758a-a30e-4dac-b615-412c39539918 req-184d3e34-3160-49dd-a320-b55f36558ac1 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:44.232347 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-8b7c758a-a30e-4dac-b615-412c39539918 req-184d3e34-3160-49dd-a320-b55f36558ac1 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:44.260155 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-8b7c758a-a30e-4dac-b615-412c39539918 req-184d3e34-3160-49dd-a320-b55f36558ac1 service nova] Creating event network-vif-deleted:f6cc1e71-5824-4e10-98c9-72b30b663270 for instance 6d312821-22fc-4f7a-9a04-88f677a66511 on hv-cinder-85031 Jul 21 06:35:44.279330 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-8b7c758a-a30e-4dac-b615-412c39539918 req-184d3e34-3160-49dd-a320-b55f36558ac1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068160 Jul 21 06:35:44.284729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 411/808] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:44.336503 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e0edd971-8e0e-466a-8ba8-83416c54054e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'create', calling method: .version_select at 0x7f9327f87b80>, body: {"keypair": {"name": "tempest-keypair-1649535709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwvjWBdKUOiegi06nni6YiDV+btYRiDTYJi7tK3cb/Z7/msij3ikNCAmxjWfEAnAdUd3rjj0nvK+jq8rpWCoyxoCJED2NVEe4Ewoknng0ASHdukwbJ7nV6LnHu745pLyw=="}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:44.355748 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-e0edd971-8e0e-466a-8ba8-83416c54054e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Getting quotas for project b2843a54fec340e19485e7b821fc071a. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:35:44.361314 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-e0edd971-8e0e-466a-8ba8-83416c54054e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Getting quotas for user 8561734cf36e47b5ab2d7242076437ff and project b2843a54fec340e19485e7b821fc071a. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:35:44.397136 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e0edd971-8e0e-466a-8ba8-83416c54054e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064848 Jul 21 06:35:44.398046 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 398/809] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 06:35:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:35:45.007754 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-39984067-03ec-49cf-b58b-4aa91c1b63f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:45.008877 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-39984067-03ec-49cf-b58b-4aa91c1b63f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 6d312821-22fc-4f7a-9a04-88f677a66511] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:45.021099 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-39984067-03ec-49cf-b58b-4aa91c1b63f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:45.021555 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-39984067-03ec-49cf-b58b-4aa91c1b63f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:45.022370 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-39984067-03ec-49cf-b58b-4aa91c1b63f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:45.022812 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-39984067-03ec-49cf-b58b-4aa91c1b63f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:45.039147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-39984067-03ec-49cf-b58b-4aa91c1b63f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] HTTP exception thrown: Instance 6d312821-22fc-4f7a-9a04-88f677a66511 could not be found. Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-39984067-03ec-49cf-b58b-4aa91c1b63f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Request method failure captured: Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 HTTP/1.1 Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PJ-FFa9px1qCFnQ_sVPIFJANLwiQsrfzGqBK9nRcF_7iLo1GNYjYZxw0dARm7jCwmHAsciC1YM2eh222mYLJQw7VTxzlGyzWumMt_LTTamWiA7oArJUmVZuWCK9D7wzeppFw1Lud6bU_EHLtCwlZMUAtguGU1smt37yBYtT3R5G4sQ Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 9cd8a1a642a24b519aefdde9ed336536 Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:35:45.040839 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9cd8a1a642a24b519aefdde9ed336536"}]}] Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 9cd8a1a642a24b519aefdde9ed336536 Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-ServerRescueNegativeTestJSON-1302720953-project Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 774dd66c674a4955a439afd30354efab Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1302720953-project Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 6d312821-22fc-4f7a-9a04-88f677a66511 could not be found. Jul 21 06:35:45.042434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '6d312821-22fc-4f7a-9a04-88f677a66511'} Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d312821-22fc-4f7a-9a04-88f677a66511 could not be found. Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:35:45.043362 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d312821-22fc-4f7a-9a04-88f677a66511 could not be found. Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d312821-22fc-4f7a-9a04-88f677a66511 could not be found. Jul 21 06:35:45.044769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:45.046870 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-39984067-03ec-49cf-b58b-4aa91c1b63f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Returning 404 to user: Instance 6d312821-22fc-4f7a-9a04-88f677a66511 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:35:45.047910 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-39984067-03ec-49cf-b58b-4aa91c1b63f0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511" status: 404 len: 111 microversion: 2.1 time: 0.045475 Jul 21 06:35:45.052218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 412/810] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:45 2022] GET /compute/v2.1/servers/6d312821-22fc-4f7a-9a04-88f677a66511 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:35:45.060643 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-abb0f6d1-d7d5-4a28-be0f-e9d03313662d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '.version_select at 0x7f9327b7c280>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:45.083584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-abb0f6d1-d7d5-4a28-be0f-e9d03313662d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170762651" status: 202 len: 0 microversion: 2.1 time: 0.030406 Jul 21 06:35:45.084249 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 399/811] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jul 21 06:35:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170762651 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 06:35:45.768676 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1432465526", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1554b7d-10e2-4dcf-85e9-e6a44388f0b3"}], "security_groups": [{"name": "tempest-securitygroup--1198917213"}], "key_name": "tempest-keypair-1649535709", "user_data": "}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:45.876305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] validate_networks() for [('a1554b7d-10e2-4dcf-85e9-e6a44388f0b3', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:35:46.421705 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ebecd416-a7df-4110-86fc-f57ada6b8639 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:46.422296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ebecd416-a7df-4110-86fc-f57ada6b8639 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:46.428837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ebecd416-a7df-4110-86fc-f57ada6b8639 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:46.429294 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ebecd416-a7df-4110-86fc-f57ada6b8639 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:46.430088 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ebecd416-a7df-4110-86fc-f57ada6b8639 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:46.430558 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ebecd416-a7df-4110-86fc-f57ada6b8639 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:46.510848 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-ebecd416-a7df-4110-86fc-f57ada6b8639 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lazy-loading 'services' on Instance uuid 5ff99e0c-a820-4b04-8b0d-11dd7a778394 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:46.515924 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:35:46.516416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:35:46.516813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:35:46.517224 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:35:46.517669 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:35:46.526667 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:46.527709 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:46.528577 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:46.529087 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:46.546460 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Getting quotas for project b2843a54fec340e19485e7b821fc071a. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:35:46.550406 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Getting quotas for user 8561734cf36e47b5ab2d7242076437ff and project b2843a54fec340e19485e7b821fc071a. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:35:46.561432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:35:46.563699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:35:46.580822 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ebecd416-a7df-4110-86fc-f57ada6b8639 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394/os-volume_attachments/4e49da76-1f0a-4a5c-89a6-aafc1497ec88" status: 202 len: 0 microversion: 2.1 time: 0.164991 Jul 21 06:35:46.581423 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 400/812] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:35:46 2022] DELETE /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394/os-volume_attachments/4e49da76-1f0a-4a5c-89a6-aafc1497ec88 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 06:35:46.615193 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a3f3941b-7da7-40bd-a51f-10911271d003 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.850566 Jul 21 06:35:46.616008 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 413/813] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:35:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:35:46.630240 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-709dcea9-605d-4be9-8b8b-5e28370d040a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:46.630890 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-709dcea9-605d-4be9-8b8b-5e28370d040a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:46.694095 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-709dcea9-605d-4be9-8b8b-5e28370d040a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:46.701258 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-709dcea9-605d-4be9-8b8b-5e28370d040a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1238 microversion: 2.1 time: 0.075995 Jul 21 06:35:46.702251 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 401/814] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:46 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:47.262770 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-71e0d9e1-05a2-4412-b495-758be5d5a67d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:47.263307 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-71e0d9e1-05a2-4412-b495-758be5d5a67d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:47.270091 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71e0d9e1-05a2-4412-b495-758be5d5a67d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:47.270547 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71e0d9e1-05a2-4412-b495-758be5d5a67d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:47.271323 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71e0d9e1-05a2-4412-b495-758be5d5a67d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:47.271767 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-71e0d9e1-05a2-4412-b495-758be5d5a67d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:47.298843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-71e0d9e1-05a2-4412-b495-758be5d5a67d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:35:47.376124 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-71e0d9e1-05a2-4412-b495-758be5d5a67d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 204 len: 0 microversion: 2.1 time: 0.117880 Jul 21 06:35:47.379799 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 414/815] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:35:47 2022] DELETE /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:35:47.388480 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e256489b-ac72-453b-91e0-35e9f035789e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:47.389450 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e256489b-ac72-453b-91e0-35e9f035789e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:47.396154 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e256489b-ac72-453b-91e0-35e9f035789e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:47.397363 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e256489b-ac72-453b-91e0-35e9f035789e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:47.399413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e256489b-ac72-453b-91e0-35e9f035789e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:47.399955 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e256489b-ac72-453b-91e0-35e9f035789e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:47.537137 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e256489b-ac72-453b-91e0-35e9f035789e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:47.544757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e256489b-ac72-453b-91e0-35e9f035789e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1579 microversion: 2.1 time: 0.163446 Jul 21 06:35:47.545324 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 402/816] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:47 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:47.710077 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-41bffd0c-54a2-4741-85e6-a0a71cc9c1b0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:47.710669 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-41bffd0c-54a2-4741-85e6-a0a71cc9c1b0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:47.717291 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-41bffd0c-54a2-4741-85e6-a0a71cc9c1b0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:47.717742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-41bffd0c-54a2-4741-85e6-a0a71cc9c1b0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:47.718415 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-13c362f5-7897-4b1d-a373-3690bcc84d6a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:47.718541 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-41bffd0c-54a2-4741-85e6-a0a71cc9c1b0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:47.718955 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-41bffd0c-54a2-4741-85e6-a0a71cc9c1b0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:47.719070 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-13c362f5-7897-4b1d-a373-3690bcc84d6a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:47.724893 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13c362f5-7897-4b1d-a373-3690bcc84d6a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:47.725340 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13c362f5-7897-4b1d-a373-3690bcc84d6a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:47.726130 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13c362f5-7897-4b1d-a373-3690bcc84d6a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:47.726568 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13c362f5-7897-4b1d-a373-3690bcc84d6a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:47.743916 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-41bffd0c-54a2-4741-85e6-a0a71cc9c1b0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:35:47.789282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-13c362f5-7897-4b1d-a373-3690bcc84d6a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:47.796871 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-13c362f5-7897-4b1d-a373-3690bcc84d6a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1290 microversion: 2.1 time: 0.083034 Jul 21 06:35:47.797504 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 403/817] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:47 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:47.820506 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-41bffd0c-54a2-4741-85e6-a0a71cc9c1b0 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 204 len: 0 microversion: 2.1 time: 0.114344 Jul 21 06:35:47.821092 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 415/818] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:35:47 2022] DELETE /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:35:47.829867 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ce21b4eb-aff0-4b76-9b6e-d63bd0427eed tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:47.830530 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ce21b4eb-aff0-4b76-9b6e-d63bd0427eed tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:47.836493 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce21b4eb-aff0-4b76-9b6e-d63bd0427eed tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:47.836951 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce21b4eb-aff0-4b76-9b6e-d63bd0427eed tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:47.837722 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce21b4eb-aff0-4b76-9b6e-d63bd0427eed tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:47.838196 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce21b4eb-aff0-4b76-9b6e-d63bd0427eed tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:47.967083 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ce21b4eb-aff0-4b76-9b6e-d63bd0427eed tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:47.975063 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ce21b4eb-aff0-4b76-9b6e-d63bd0427eed tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1558 microversion: 2.1 time: 0.149161 Jul 21 06:35:47.975626 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 404/819] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:47 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:48.030798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9e0f097b-b425-49d9-b49a-422c8edb44c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:48.031397 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9e0f097b-b425-49d9-b49a-422c8edb44c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:48.037242 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9e0f097b-b425-49d9-b49a-422c8edb44c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:48.037694 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9e0f097b-b425-49d9-b49a-422c8edb44c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:48.038501 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9e0f097b-b425-49d9-b49a-422c8edb44c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:48.038936 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9e0f097b-b425-49d9-b49a-422c8edb44c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:48.064448 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9e0f097b-b425-49d9-b49a-422c8edb44c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:35:48.136917 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9e0f097b-b425-49d9-b49a-422c8edb44c0 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "DELETE /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 204 len: 0 microversion: 2.1 time: 0.109725 Jul 21 06:35:48.137514 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 416/820] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:35:48 2022] DELETE /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:35:48.145439 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-223e1679-614e-455b-9e96-b336022260a2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:48.146093 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-223e1679-614e-455b-9e96-b336022260a2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:48.152510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-223e1679-614e-455b-9e96-b336022260a2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:48.152969 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-223e1679-614e-455b-9e96-b336022260a2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:48.153731 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-223e1679-614e-455b-9e96-b336022260a2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:48.154205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-223e1679-614e-455b-9e96-b336022260a2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:48.283868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-223e1679-614e-455b-9e96-b336022260a2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:48.291207 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-223e1679-614e-455b-9e96-b336022260a2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1508 microversion: 2.1 time: 0.149614 Jul 21 06:35:48.291769 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 405/821] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:48 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:48.562828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3d371753-5b01-41cb-b951-67e569c8437a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:48.563453 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3d371753-5b01-41cb-b951-67e569c8437a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:48.569919 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d371753-5b01-41cb-b951-67e569c8437a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:48.570406 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d371753-5b01-41cb-b951-67e569c8437a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:48.571168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d371753-5b01-41cb-b951-67e569c8437a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:48.571609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d371753-5b01-41cb-b951-67e569c8437a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:48.705786 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3d371753-5b01-41cb-b951-67e569c8437a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:48.713352 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3d371753-5b01-41cb-b951-67e569c8437a tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1579 microversion: 2.1 time: 0.154893 Jul 21 06:35:48.713927 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 417/822] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:48 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:48.818109 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-90009ed8-ab9b-4451-80bb-e2175e1089b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:48.818661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-90009ed8-ab9b-4451-80bb-e2175e1089b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:48.831815 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-90009ed8-ab9b-4451-80bb-e2175e1089b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:48.832267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-90009ed8-ab9b-4451-80bb-e2175e1089b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:48.833047 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-90009ed8-ab9b-4451-80bb-e2175e1089b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:48.833488 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-90009ed8-ab9b-4451-80bb-e2175e1089b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:48.899455 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-90009ed8-ab9b-4451-80bb-e2175e1089b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:48.902937 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:48.907661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-90009ed8-ab9b-4451-80bb-e2175e1089b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1290 microversion: 2.1 time: 0.094864 Jul 21 06:35:48.908200 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 406/823] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:48 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:48.992302 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e21ed1c3-7e47-4edf-ae70-1a2a13596afe tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:48.992920 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e21ed1c3-7e47-4edf-ae70-1a2a13596afe tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:48.999723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e21ed1c3-7e47-4edf-ae70-1a2a13596afe tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:49.000178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e21ed1c3-7e47-4edf-ae70-1a2a13596afe tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:49.000946 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e21ed1c3-7e47-4edf-ae70-1a2a13596afe tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:49.001384 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e21ed1c3-7e47-4edf-ae70-1a2a13596afe tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:49.135184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e21ed1c3-7e47-4edf-ae70-1a2a13596afe tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:49.142753 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e21ed1c3-7e47-4edf-ae70-1a2a13596afe tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1512 microversion: 2.1 time: 0.154283 Jul 21 06:35:49.143317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 418/824] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:48 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:49.309512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fd7758c1-8282-4d01-b83a-c0b15c7598dd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:49.310157 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fd7758c1-8282-4d01-b83a-c0b15c7598dd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:49.316443 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fd7758c1-8282-4d01-b83a-c0b15c7598dd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:49.316898 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fd7758c1-8282-4d01-b83a-c0b15c7598dd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:49.317665 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fd7758c1-8282-4d01-b83a-c0b15c7598dd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:49.318152 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fd7758c1-8282-4d01-b83a-c0b15c7598dd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:49.446978 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fd7758c1-8282-4d01-b83a-c0b15c7598dd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:49.454703 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fd7758c1-8282-4d01-b83a-c0b15c7598dd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1508 microversion: 2.1 time: 0.149752 Jul 21 06:35:49.455261 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 407/825] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:49 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:49.730636 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8ebc1436-dd7a-446b-94e9-f309eef759f4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:49.731163 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8ebc1436-dd7a-446b-94e9-f309eef759f4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:49.737491 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8ebc1436-dd7a-446b-94e9-f309eef759f4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:49.737960 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8ebc1436-dd7a-446b-94e9-f309eef759f4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:49.738736 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8ebc1436-dd7a-446b-94e9-f309eef759f4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:49.739169 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8ebc1436-dd7a-446b-94e9-f309eef759f4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:49.871730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8ebc1436-dd7a-446b-94e9-f309eef759f4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:49.879156 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8ebc1436-dd7a-446b-94e9-f309eef759f4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1579 microversion: 2.1 time: 0.152595 Jul 21 06:35:49.879723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 419/826] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:49 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:49.924945 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7418bcc0-69b0-499b-bc43-3c63adc26a25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:49.925680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7418bcc0-69b0-499b-bc43-3c63adc26a25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:49.932109 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7418bcc0-69b0-499b-bc43-3c63adc26a25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:49.932563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7418bcc0-69b0-499b-bc43-3c63adc26a25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:49.933996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7418bcc0-69b0-499b-bc43-3c63adc26a25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:49.934612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7418bcc0-69b0-499b-bc43-3c63adc26a25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:49.994731 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7418bcc0-69b0-499b-bc43-3c63adc26a25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:50.002786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7418bcc0-69b0-499b-bc43-3c63adc26a25 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1290 microversion: 2.1 time: 0.081739 Jul 21 06:35:50.003745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 408/827] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:49 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:50.160184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0272a8bc-60af-475c-a233-618dad38284b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:50.160790 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0272a8bc-60af-475c-a233-618dad38284b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:50.166826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0272a8bc-60af-475c-a233-618dad38284b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:50.167273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0272a8bc-60af-475c-a233-618dad38284b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:50.168852 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0272a8bc-60af-475c-a233-618dad38284b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:50.169288 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0272a8bc-60af-475c-a233-618dad38284b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:50.297340 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0272a8bc-60af-475c-a233-618dad38284b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:50.306111 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0272a8bc-60af-475c-a233-618dad38284b tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1512 microversion: 2.1 time: 0.149471 Jul 21 06:35:50.307039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 420/828] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:50 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:50.472693 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-90db7830-3af7-44e4-8347-747af788c468 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:50.473301 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-90db7830-3af7-44e4-8347-747af788c468 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:50.479280 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-90db7830-3af7-44e4-8347-747af788c468 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:50.479727 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-90db7830-3af7-44e4-8347-747af788c468 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:50.481086 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-90db7830-3af7-44e4-8347-747af788c468 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:50.481541 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-90db7830-3af7-44e4-8347-747af788c468 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:50.611641 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-90db7830-3af7-44e4-8347-747af788c468 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:50.619019 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-90db7830-3af7-44e4-8347-747af788c468 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1508 microversion: 2.1 time: 0.150186 Jul 21 06:35:50.619576 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 409/829] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:50 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:50.898411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-867a71d4-1cf1-4e94-aa85-83c3b8d87188 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:50.899397 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-867a71d4-1cf1-4e94-aa85-83c3b8d87188 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:50.906449 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-867a71d4-1cf1-4e94-aa85-83c3b8d87188 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:50.906899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-867a71d4-1cf1-4e94-aa85-83c3b8d87188 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:50.907658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-867a71d4-1cf1-4e94-aa85-83c3b8d87188 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:50.908093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-867a71d4-1cf1-4e94-aa85-83c3b8d87188 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:50.926488 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:51.019186 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-26f578d9-fd04-4f2c-ac18-d9a7501509d7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:51.019800 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-26f578d9-fd04-4f2c-ac18-d9a7501509d7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:51.026465 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-26f578d9-fd04-4f2c-ac18-d9a7501509d7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:51.026921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-26f578d9-fd04-4f2c-ac18-d9a7501509d7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:51.028268 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-26f578d9-fd04-4f2c-ac18-d9a7501509d7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:51.028655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-26f578d9-fd04-4f2c-ac18-d9a7501509d7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:51.039867 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-867a71d4-1cf1-4e94-aa85-83c3b8d87188 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:51.062791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-867a71d4-1cf1-4e94-aa85-83c3b8d87188 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1579 microversion: 2.1 time: 0.168459 Jul 21 06:35:51.063556 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 421/830] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:50 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:51.104631 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-26f578d9-fd04-4f2c-ac18-d9a7501509d7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:51.112588 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-26f578d9-fd04-4f2c-ac18-d9a7501509d7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1290 microversion: 2.1 time: 0.097225 Jul 21 06:35:51.113157 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 410/831] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:51 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:51.324986 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-86d16a11-3a52-417f-818e-978ac0485115 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:51.325598 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-86d16a11-3a52-417f-818e-978ac0485115 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:51.331556 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-86d16a11-3a52-417f-818e-978ac0485115 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:51.331998 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-86d16a11-3a52-417f-818e-978ac0485115 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:51.332752 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-86d16a11-3a52-417f-818e-978ac0485115 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:51.333183 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-86d16a11-3a52-417f-818e-978ac0485115 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:51.466904 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-86d16a11-3a52-417f-818e-978ac0485115 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:51.474208 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-86d16a11-3a52-417f-818e-978ac0485115 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1512 microversion: 2.1 time: 0.153939 Jul 21 06:35:51.474772 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 422/832] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:51 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:51.637245 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-22ab0a87-2be7-476e-b682-cc82a0d3ef66 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:51.637870 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-22ab0a87-2be7-476e-b682-cc82a0d3ef66 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:51.643965 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-22ab0a87-2be7-476e-b682-cc82a0d3ef66 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:51.644426 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-22ab0a87-2be7-476e-b682-cc82a0d3ef66 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:51.645195 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-22ab0a87-2be7-476e-b682-cc82a0d3ef66 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:51.645641 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-22ab0a87-2be7-476e-b682-cc82a0d3ef66 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:51.772445 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-22ab0a87-2be7-476e-b682-cc82a0d3ef66 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:51.780461 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-22ab0a87-2be7-476e-b682-cc82a0d3ef66 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1508 microversion: 2.1 time: 0.147819 Jul 21 06:35:51.781028 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 411/833] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:51 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:52.080044 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f7e3ed3e-1b1e-4cba-9549-4ed7ee747df3 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:52.080658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f7e3ed3e-1b1e-4cba-9549-4ed7ee747df3 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:52.087152 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7e3ed3e-1b1e-4cba-9549-4ed7ee747df3 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:52.087601 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7e3ed3e-1b1e-4cba-9549-4ed7ee747df3 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:52.088363 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7e3ed3e-1b1e-4cba-9549-4ed7ee747df3 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:52.088801 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f7e3ed3e-1b1e-4cba-9549-4ed7ee747df3 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:52.129880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-df541128-9327-4d9d-a136-4e91aac97efb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:52.130529 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-df541128-9327-4d9d-a136-4e91aac97efb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:52.137022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df541128-9327-4d9d-a136-4e91aac97efb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:52.137480 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df541128-9327-4d9d-a136-4e91aac97efb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:52.138306 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df541128-9327-4d9d-a136-4e91aac97efb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:52.138751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df541128-9327-4d9d-a136-4e91aac97efb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:52.212886 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-df541128-9327-4d9d-a136-4e91aac97efb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:52.220486 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-df541128-9327-4d9d-a136-4e91aac97efb tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1290 microversion: 2.1 time: 0.094397 Jul 21 06:35:52.221066 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 412/834] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:52 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:52.244051 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f7e3ed3e-1b1e-4cba-9549-4ed7ee747df3 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:52.252231 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f7e3ed3e-1b1e-4cba-9549-4ed7ee747df3 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1579 microversion: 2.1 time: 0.176125 Jul 21 06:35:52.252789 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 423/835] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:52 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:52.491840 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-75b00cbd-8961-4d21-b35b-42e44d43fac8 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:52.492457 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-75b00cbd-8961-4d21-b35b-42e44d43fac8 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:52.498771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75b00cbd-8961-4d21-b35b-42e44d43fac8 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:52.499225 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75b00cbd-8961-4d21-b35b-42e44d43fac8 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:52.499991 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75b00cbd-8961-4d21-b35b-42e44d43fac8 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:52.500431 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-75b00cbd-8961-4d21-b35b-42e44d43fac8 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:52.627227 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-75b00cbd-8961-4d21-b35b-42e44d43fac8 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:52.634680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-75b00cbd-8961-4d21-b35b-42e44d43fac8 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1512 microversion: 2.1 time: 0.146749 Jul 21 06:35:52.635245 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 413/836] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:52 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:52.796640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-858ef0e2-8cea-46b2-aef6-6de02f379c7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:52.797176 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-858ef0e2-8cea-46b2-aef6-6de02f379c7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:52.803262 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-858ef0e2-8cea-46b2-aef6-6de02f379c7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:52.803734 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-858ef0e2-8cea-46b2-aef6-6de02f379c7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:52.804464 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-858ef0e2-8cea-46b2-aef6-6de02f379c7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:52.804898 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-858ef0e2-8cea-46b2-aef6-6de02f379c7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:52.933816 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-858ef0e2-8cea-46b2-aef6-6de02f379c7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:52.941413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-858ef0e2-8cea-46b2-aef6-6de02f379c7d tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1508 microversion: 2.1 time: 0.148748 Jul 21 06:35:52.941996 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 424/837] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:52 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:53.237078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-65fae8df-2ee6-495c-ad39-8a3523ab32b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:53.237726 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-65fae8df-2ee6-495c-ad39-8a3523ab32b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:53.244156 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-65fae8df-2ee6-495c-ad39-8a3523ab32b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:53.244611 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-65fae8df-2ee6-495c-ad39-8a3523ab32b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:53.245375 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-65fae8df-2ee6-495c-ad39-8a3523ab32b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:53.246403 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-65fae8df-2ee6-495c-ad39-8a3523ab32b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:53.269047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6b9a352f-bc5a-46ac-8a7a-789921cedc21 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:53.269660 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6b9a352f-bc5a-46ac-8a7a-789921cedc21 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:53.276325 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b9a352f-bc5a-46ac-8a7a-789921cedc21 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:53.276774 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b9a352f-bc5a-46ac-8a7a-789921cedc21 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:53.277614 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b9a352f-bc5a-46ac-8a7a-789921cedc21 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:53.278090 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6b9a352f-bc5a-46ac-8a7a-789921cedc21 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:53.309525 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-65fae8df-2ee6-495c-ad39-8a3523ab32b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:53.317212 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-65fae8df-2ee6-495c-ad39-8a3523ab32b1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1290 microversion: 2.1 time: 0.083903 Jul 21 06:35:53.318006 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 414/838] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:53 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:53.416262 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6b9a352f-bc5a-46ac-8a7a-789921cedc21 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:53.424582 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6b9a352f-bc5a-46ac-8a7a-789921cedc21 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1579 microversion: 2.1 time: 0.159362 Jul 21 06:35:53.425152 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 425/839] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:53 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:53.653216 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8e289f6a-5314-4d66-9331-5687e4268de6 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:53.653786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8e289f6a-5314-4d66-9331-5687e4268de6 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:53.659851 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8e289f6a-5314-4d66-9331-5687e4268de6 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:53.660310 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8e289f6a-5314-4d66-9331-5687e4268de6 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:53.661079 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8e289f6a-5314-4d66-9331-5687e4268de6 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:53.661520 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8e289f6a-5314-4d66-9331-5687e4268de6 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:53.801474 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8e289f6a-5314-4d66-9331-5687e4268de6 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:53.809371 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8e289f6a-5314-4d66-9331-5687e4268de6 tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1512 microversion: 2.1 time: 0.160961 Jul 21 06:35:53.809955 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 415/840] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:53 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:53.959205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-49e90c0e-2cec-4bbd-b16c-d337b7177fdb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:53.959735 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-49e90c0e-2cec-4bbd-b16c-d337b7177fdb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:53.968034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49e90c0e-2cec-4bbd-b16c-d337b7177fdb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:53.968670 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49e90c0e-2cec-4bbd-b16c-d337b7177fdb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:53.969671 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49e90c0e-2cec-4bbd-b16c-d337b7177fdb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:53.970042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-49e90c0e-2cec-4bbd-b16c-d337b7177fdb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:54.151936 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-49e90c0e-2cec-4bbd-b16c-d337b7177fdb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:54.160319 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-49e90c0e-2cec-4bbd-b16c-d337b7177fdb tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1508 microversion: 2.1 time: 0.205208 Jul 21 06:35:54.161035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 426/841] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:53 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:54.335209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-32bef212-6398-405f-b352-add21953ffb8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:54.335993 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-32bef212-6398-405f-b352-add21953ffb8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:54.343774 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-32bef212-6398-405f-b352-add21953ffb8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:54.344503 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-32bef212-6398-405f-b352-add21953ffb8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:54.345480 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-32bef212-6398-405f-b352-add21953ffb8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:54.346180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-32bef212-6398-405f-b352-add21953ffb8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:54.442400 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7a4c67a8-45a7-46b5-a580-5314aa777685 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:54.443009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7a4c67a8-45a7-46b5-a580-5314aa777685 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:54.450699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a4c67a8-45a7-46b5-a580-5314aa777685 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:54.452024 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a4c67a8-45a7-46b5-a580-5314aa777685 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:54.453064 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a4c67a8-45a7-46b5-a580-5314aa777685 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:54.453690 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a4c67a8-45a7-46b5-a580-5314aa777685 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:54.454576 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-32bef212-6398-405f-b352-add21953ffb8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:54.464661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-32bef212-6398-405f-b352-add21953ffb8 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1296 microversion: 2.1 time: 0.132939 Jul 21 06:35:54.474448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 416/842] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:54 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1296 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:54.774637 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7a4c67a8-45a7-46b5-a580-5314aa777685 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:54.789675 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7a4c67a8-45a7-46b5-a580-5314aa777685 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1579 microversion: 2.1 time: 0.351255 Jul 21 06:35:54.807135 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 427/843] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:54 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1579 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:54.826919 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fb25626d-d9f9-418d-ac32-0e0b6e27a95d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:54.827799 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fb25626d-d9f9-418d-ac32-0e0b6e27a95d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:54.834826 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb25626d-d9f9-418d-ac32-0e0b6e27a95d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:54.838230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb25626d-d9f9-418d-ac32-0e0b6e27a95d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:54.841812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb25626d-d9f9-418d-ac32-0e0b6e27a95d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:54.843554 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fb25626d-d9f9-418d-ac32-0e0b6e27a95d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:54.869487 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-0e67ce86-0879-4fa5-bea7-d20f28fc8b38 req-c6620870-5b4b-4346-b8c8-17d1b72d09ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294d6ad3-39c8-4bd2-85f6-3ba438468dd4", "name": "network-vif-deleted", "tag": "d86e2ff8-1a3b-4b59-926e-c459aef0506d"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:54.891712 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-0e67ce86-0879-4fa5-bea7-d20f28fc8b38 req-c6620870-5b4b-4346-b8c8-17d1b72d09ce service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:54.892209 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-0e67ce86-0879-4fa5-bea7-d20f28fc8b38 req-c6620870-5b4b-4346-b8c8-17d1b72d09ce service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:54.931205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-0e67ce86-0879-4fa5-bea7-d20f28fc8b38 req-c6620870-5b4b-4346-b8c8-17d1b72d09ce service nova] Creating event network-vif-deleted:d86e2ff8-1a3b-4b59-926e-c459aef0506d for instance 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 on hv-cinder-85031 Jul 21 06:35:54.947018 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-0e67ce86-0879-4fa5-bea7-d20f28fc8b38 req-c6620870-5b4b-4346-b8c8-17d1b72d09ce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094105 Jul 21 06:35:54.948008 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 428/844] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:55.153097 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-e264836e-d2e2-4284-918c-751065aa296f req-3c3d71b3-f13f-402f-867e-adee40581c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff99e0c-a820-4b04-8b0d-11dd7a778394", "name": "network-vif-deleted", "tag": "fa58ed41-a634-46cf-b791-e38329e29479"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:55.163216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-e264836e-d2e2-4284-918c-751065aa296f req-3c3d71b3-f13f-402f-867e-adee40581c8a service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:55.163665 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-e264836e-d2e2-4284-918c-751065aa296f req-3c3d71b3-f13f-402f-867e-adee40581c8a service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:55.177970 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-e264836e-d2e2-4284-918c-751065aa296f req-3c3d71b3-f13f-402f-867e-adee40581c8a service nova] Creating event network-vif-deleted:fa58ed41-a634-46cf-b791-e38329e29479 for instance 5ff99e0c-a820-4b04-8b0d-11dd7a778394 on hv-cinder-85031 Jul 21 06:35:55.184708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-e264836e-d2e2-4284-918c-751065aa296f req-3c3d71b3-f13f-402f-867e-adee40581c8a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036330 Jul 21 06:35:55.186249 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 429/845] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:35:55.193994 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:55.195027 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:55.204666 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:55.205614 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:55.206446 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:55.207130 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:55.245669 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:55.246297 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:55.246758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lazy-loading 'fault' on Instance uuid 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:55.293206 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fb25626d-d9f9-418d-ac32-0e0b6e27a95d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efafaa14b3e146eba88412c382a8b977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854daeeee974410c9a0afafee795e72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:55.303781 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fb25626d-d9f9-418d-ac32-0e0b6e27a95d tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 200 len: 1512 microversion: 2.1 time: 0.479146 Jul 21 06:35:55.305027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 417/846] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:54 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:55.379410 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:55.388781 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-aae7c636-3ebf-4ed8-8fe1-56f4444bdffc tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 200 len: 1312 microversion: 2.1 time: 0.201288 Jul 21 06:35:55.389370 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 430/847] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:55 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:55.483395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9eed12de-515f-4b5e-9364-6c8053fafb47 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:55.485190 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9eed12de-515f-4b5e-9364-6c8053fafb47 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:55.493237 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9eed12de-515f-4b5e-9364-6c8053fafb47 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:55.493696 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9eed12de-515f-4b5e-9364-6c8053fafb47 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:55.495042 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9eed12de-515f-4b5e-9364-6c8053fafb47 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:55.497802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9eed12de-515f-4b5e-9364-6c8053fafb47 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:55.772650 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9eed12de-515f-4b5e-9364-6c8053fafb47 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:55.789048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9eed12de-515f-4b5e-9364-6c8053fafb47 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.310646 Jul 21 06:35:55.790661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 418/848] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:55 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:55.813027 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-27f58cfa-dffa-4c41-981c-e70f57a99417 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:55.814631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-27f58cfa-dffa-4c41-981c-e70f57a99417 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:55.823493 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-27f58cfa-dffa-4c41-981c-e70f57a99417 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:55.825561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-27f58cfa-dffa-4c41-981c-e70f57a99417 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:55.826606 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-27f58cfa-dffa-4c41-981c-e70f57a99417 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:55.827042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-27f58cfa-dffa-4c41-981c-e70f57a99417 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:55.941358 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-27f58cfa-dffa-4c41-981c-e70f57a99417 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:55.954147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-27f58cfa-dffa-4c41-981c-e70f57a99417 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1512 microversion: 2.1 time: 0.145691 Jul 21 06:35:55.969357 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 431/849] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:55 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:56.328003 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-10b16ff0-0e63-4cd0-9ef8-0f0eb672ea8f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:56.329024 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-10b16ff0-0e63-4cd0-9ef8-0f0eb672ea8f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] [instance: 5ff99e0c-a820-4b04-8b0d-11dd7a778394] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:56.337666 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-10b16ff0-0e63-4cd0-9ef8-0f0eb672ea8f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.338359 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-10b16ff0-0e63-4cd0-9ef8-0f0eb672ea8f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.339289 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-10b16ff0-0e63-4cd0-9ef8-0f0eb672ea8f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.340368 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-10b16ff0-0e63-4cd0-9ef8-0f0eb672ea8f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.354647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-10b16ff0-0e63-4cd0-9ef8-0f0eb672ea8f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] HTTP exception thrown: Instance 5ff99e0c-a820-4b04-8b0d-11dd7a778394 could not be found. Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-10b16ff0-0e63-4cd0-9ef8-0f0eb672ea8f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Request method failure captured: Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 HTTP/1.1 Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PM8es5ETUXXh09-RFFmQhndXlOmW0FGNVD1qmemXDrz8XuWJlsa5LXRfprQM6Ewvw_JnGaeVtlvZmfGavq1P5Upe0-IAuvh_9GeQucSHDfRszD-LYWKDfCZFNsZkNc2ljda_AYlmTsKbHEH5FX18H0roEVtumh7cGWLEvisRASvlqA Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: 854daeeee974410c9a0afafee795e72c Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1771296309 Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:35:56.356949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/854daeeee974410c9a0afafee795e72c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/854daeeee974410c9a0afafee795e72c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/854daeeee974410c9a0afafee795e72c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_854daeeee974410c9a0afafee795e72c"}]}] Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-VolumesSnapshotTestJSON-1771296309 Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: 854daeeee974410c9a0afafee795e72c Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1771296309 Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-VolumesSnapshotTestJSON-1771296309-project Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: efafaa14b3e146eba88412c382a8b977 Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-VolumesSnapshotTestJSON-1771296309-project Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance 5ff99e0c-a820-4b04-8b0d-11dd7a778394 could not be found. Jul 21 06:35:56.358612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '5ff99e0c-a820-4b04-8b0d-11dd7a778394'} Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff99e0c-a820-4b04-8b0d-11dd7a778394 could not be found. Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:35:56.359594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff99e0c-a820-4b04-8b0d-11dd7a778394 could not be found. Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff99e0c-a820-4b04-8b0d-11dd7a778394 could not be found. Jul 21 06:35:56.361113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:35:56.362762 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-10b16ff0-0e63-4cd0-9ef8-0f0eb672ea8f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] Returning 404 to user: Instance 5ff99e0c-a820-4b04-8b0d-11dd7a778394 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:35:56.363177 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-10b16ff0-0e63-4cd0-9ef8-0f0eb672ea8f tempest-VolumesSnapshotTestJSON-1771296309 tempest-VolumesSnapshotTestJSON-1771296309-project] 10.222.0.42 "GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394" status: 404 len: 111 microversion: 2.1 time: 0.043204 Jul 21 06:35:56.376810 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 419/850] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:56 2022] GET /compute/v2.1/servers/5ff99e0c-a820-4b04-8b0d-11dd7a778394 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:35:56.407516 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c5728110-3a7f-4ee3-802b-1dc578cef0b2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:56.408345 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c5728110-3a7f-4ee3-802b-1dc578cef0b2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 294d6ad3-39c8-4bd2-85f6-3ba438468dd4] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:56.423423 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5728110-3a7f-4ee3-802b-1dc578cef0b2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.424104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5728110-3a7f-4ee3-802b-1dc578cef0b2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.427304 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5728110-3a7f-4ee3-802b-1dc578cef0b2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.427899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5728110-3a7f-4ee3-802b-1dc578cef0b2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.452969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-c5728110-3a7f-4ee3-802b-1dc578cef0b2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] HTTP exception thrown: Instance 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 could not be found. Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c5728110-3a7f-4ee3-802b-1dc578cef0b2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Request method failure captured: Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 HTTP/1.1 Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PJ-FFa9px1qCFnQ_sVPIFJANLwiQsrfzGqBK9nRcF_7iLo1GNYjYZxw0dARm7jCwmHAsciC1YM2eh222mYLJQw7VTxzlGyzWumMt_LTTamWiA7oArJUmVZuWCK9D7wzeppFw1Lud6bU_EHLtCwlZMUAtguGU1smt37yBYtT3R5G4sQ Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 9cd8a1a642a24b519aefdde9ed336536 Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:35:56.455873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9cd8a1a642a24b519aefdde9ed336536"}]}] Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 9cd8a1a642a24b519aefdde9ed336536 Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-ServerRescueNegativeTestJSON-1302720953-project Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 774dd66c674a4955a439afd30354efab Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1302720953-project Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 could not be found. Jul 21 06:35:56.457398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '294d6ad3-39c8-4bd2-85f6-3ba438468dd4'} Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 could not be found. Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:35:56.458432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 could not be found. Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 could not be found. Jul 21 06:35:56.459878 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:35:56.461148 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c5728110-3a7f-4ee3-802b-1dc578cef0b2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Returning 404 to user: Instance 294d6ad3-39c8-4bd2-85f6-3ba438468dd4 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:35:56.461316 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c5728110-3a7f-4ee3-802b-1dc578cef0b2 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4" status: 404 len: 111 microversion: 2.1 time: 0.058900 Jul 21 06:35:56.471568 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e2f70ef1-f73d-44bd-a72e-fe20a4150571 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:56.472420 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e2f70ef1-f73d-44bd-a72e-fe20a4150571 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:56.477983 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 432/851] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:56 2022] GET /compute/v2.1/servers/294d6ad3-39c8-4bd2-85f6-3ba438468dd4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:35:56.480671 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e2f70ef1-f73d-44bd-a72e-fe20a4150571 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.482225 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e2f70ef1-f73d-44bd-a72e-fe20a4150571 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.483266 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e2f70ef1-f73d-44bd-a72e-fe20a4150571 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.484012 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e2f70ef1-f73d-44bd-a72e-fe20a4150571 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.520247 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e2f70ef1-f73d-44bd-a72e-fe20a4150571 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:35:56.620514 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:56.639880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e2f70ef1-f73d-44bd-a72e-fe20a4150571 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "DELETE /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 204 len: 0 microversion: 2.1 time: 0.172110 Jul 21 06:35:56.643709 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 420/852] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:35:56 2022] DELETE /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:35:56.649843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e4459053-c1f1-4702-9472-9ad7e2fcdfe7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:56.650641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e4459053-c1f1-4702-9472-9ad7e2fcdfe7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:56.653857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:56.656964 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=6 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:56.661728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e4459053-c1f1-4702-9472-9ad7e2fcdfe7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.662195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e4459053-c1f1-4702-9472-9ad7e2fcdfe7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.662987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e4459053-c1f1-4702-9472-9ad7e2fcdfe7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.663433 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e4459053-c1f1-4702-9472-9ad7e2fcdfe7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.810740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b24a8dd5-486b-4188-89b6-30da26c05937 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:56.812174 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b24a8dd5-486b-4188-89b6-30da26c05937 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:56.816317 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=6 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:56.822437 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b24a8dd5-486b-4188-89b6-30da26c05937 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.826506 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b24a8dd5-486b-4188-89b6-30da26c05937 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.827882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b24a8dd5-486b-4188-89b6-30da26c05937 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.837587 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b24a8dd5-486b-4188-89b6-30da26c05937 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.880243 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e4459053-c1f1-4702-9472-9ad7e2fcdfe7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:56.894435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e4459053-c1f1-4702-9472-9ad7e2fcdfe7 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.249068 Jul 21 06:35:56.895081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 433/853] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:56 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:56.964333 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-730abe51-045f-4f4a-a4e9-3308de1d1d63 req-2221182e-118d-47f7-8a40-922f57fa38d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efabe894-210e-4604-a672-71967b164f19", "tag": "1f2280ad-29cb-4bee-9cdc-eda920400b0c"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:56.975150 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-730abe51-045f-4f4a-a4e9-3308de1d1d63 req-2221182e-118d-47f7-8a40-922f57fa38d7 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:56.975593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-730abe51-045f-4f4a-a4e9-3308de1d1d63 req-2221182e-118d-47f7-8a40-922f57fa38d7 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:56.988201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-730abe51-045f-4f4a-a4e9-3308de1d1d63 req-2221182e-118d-47f7-8a40-922f57fa38d7 service nova] Creating event network-changed:1f2280ad-29cb-4bee-9cdc-eda920400b0c for instance efabe894-210e-4604-a672-71967b164f19 on hv-cinder-85031 Jul 21 06:35:56.993437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-730abe51-045f-4f4a-a4e9-3308de1d1d63 req-2221182e-118d-47f7-8a40-922f57fa38d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032665 Jul 21 06:35:56.997248 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b24a8dd5-486b-4188-89b6-30da26c05937 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:56.997386 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 434/854] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:35:57.002340 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:57.003107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:57.006278 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b24a8dd5-486b-4188-89b6-30da26c05937 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.201477 Jul 21 06:35:57.015704 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 421/855] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:56 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:57.018343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:57.018858 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:57.019656 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:57.020102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:57.053760 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:57.054246 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:57.054703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lazy-loading 'fault' on Instance uuid 3dd12a96-a6ba-4881-9e69-20771a9b2d91 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:57.101279 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:57.108903 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-60600cc6-399e-44d4-8613-1b2306d78c63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1231 microversion: 2.1 time: 0.110656 Jul 21 06:35:57.109834 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 435/856] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:56 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:57.270023 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-3700dbd1-b550-44c7-855c-e9caa5129384 req-1edf40bf-f4f7-47b5-bd13-bd31abf3d6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd12a96-a6ba-4881-9e69-20771a9b2d91", "name": "network-vif-deleted", "tag": "30a8386c-e7fc-4d12-86c3-922716884c6e"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:35:57.279386 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-3700dbd1-b550-44c7-855c-e9caa5129384 req-1edf40bf-f4f7-47b5-bd13-bd31abf3d6b0 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:57.279830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-3700dbd1-b550-44c7-855c-e9caa5129384 req-1edf40bf-f4f7-47b5-bd13-bd31abf3d6b0 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:57.292821 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-3700dbd1-b550-44c7-855c-e9caa5129384 req-1edf40bf-f4f7-47b5-bd13-bd31abf3d6b0 service nova] Creating event network-vif-deleted:30a8386c-e7fc-4d12-86c3-922716884c6e for instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 on hv-cinder-85031 Jul 21 06:35:57.297707 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-3700dbd1-b550-44c7-855c-e9caa5129384 req-1edf40bf-f4f7-47b5-bd13-bd31abf3d6b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031324 Jul 21 06:35:57.298319 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 422/857] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:35:57.913152 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-013d5758-67c9-4161-9133-2b8f574ccff1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:57.913759 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-013d5758-67c9-4161-9133-2b8f574ccff1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:57.921157 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-013d5758-67c9-4161-9133-2b8f574ccff1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:57.921608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-013d5758-67c9-4161-9133-2b8f574ccff1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:57.922398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-013d5758-67c9-4161-9133-2b8f574ccff1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:57.922857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-013d5758-67c9-4161-9133-2b8f574ccff1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:58.023191 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3ec7a7d2-0ecf-4a34-ac34-b263660a1696 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:58.024244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3ec7a7d2-0ecf-4a34-ac34-b263660a1696 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:58.031365 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3ec7a7d2-0ecf-4a34-ac34-b263660a1696 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:58.031899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3ec7a7d2-0ecf-4a34-ac34-b263660a1696 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:58.032751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3ec7a7d2-0ecf-4a34-ac34-b263660a1696 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:58.033310 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3ec7a7d2-0ecf-4a34-ac34-b263660a1696 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:58.037441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:35:58.060886 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-013d5758-67c9-4161-9133-2b8f574ccff1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:58.068718 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-013d5758-67c9-4161-9133-2b8f574ccff1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.159322 Jul 21 06:35:58.069300 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 436/858] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:57 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:58.126519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:58.127234 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:58.133352 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:58.133901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:58.134772 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:58.135284 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:58.165834 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:58.166318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:58.166808 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lazy-loading 'fault' on Instance uuid 3dd12a96-a6ba-4881-9e69-20771a9b2d91 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:58.169821 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3ec7a7d2-0ecf-4a34-ac34-b263660a1696 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:58.177312 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3ec7a7d2-0ecf-4a34-ac34-b263660a1696 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.158233 Jul 21 06:35:58.177876 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 423/859] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:58 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:58.207643 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:58.215060 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-76a4f8e9-a370-49a7-b93e-6bbc61a3893f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1231 microversion: 2.1 time: 0.092339 Jul 21 06:35:58.215552 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 437/860] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:58 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1231 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:35:59.085714 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-00a57bce-bb4b-4ca1-a650-a78cca2e1904 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:59.086258 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-00a57bce-bb4b-4ca1-a650-a78cca2e1904 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:59.093609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-00a57bce-bb4b-4ca1-a650-a78cca2e1904 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:59.094140 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-00a57bce-bb4b-4ca1-a650-a78cca2e1904 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:59.094993 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-00a57bce-bb4b-4ca1-a650-a78cca2e1904 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:59.095447 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-00a57bce-bb4b-4ca1-a650-a78cca2e1904 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:59.194496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b2efa2db-5008-452d-978f-479a10090dbd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:59.195104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b2efa2db-5008-452d-978f-479a10090dbd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:59.201519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2efa2db-5008-452d-978f-479a10090dbd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:59.201986 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2efa2db-5008-452d-978f-479a10090dbd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:59.202756 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2efa2db-5008-452d-978f-479a10090dbd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:59.203195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2efa2db-5008-452d-978f-479a10090dbd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:59.223245 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-00a57bce-bb4b-4ca1-a650-a78cca2e1904 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:59.231711 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-00a57bce-bb4b-4ca1-a650-a78cca2e1904 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.149834 Jul 21 06:35:59.232435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 424/861] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:59 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:59.245009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:35:59.245630 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:35:59.252010 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:59.252469 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:59.253242 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:59.253684 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:59.284422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:35:59.284910 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:35:59.285370 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lazy-loading 'fault' on Instance uuid 3dd12a96-a6ba-4881-9e69-20771a9b2d91 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:35:59.337163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:59.344576 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a9a2e9e2-9dfd-4b4e-b7aa-58e1f9a1e018 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1231 microversion: 2.1 time: 0.111179 Jul 21 06:35:59.345176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 425/862] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:59 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:35:59.359363 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b2efa2db-5008-452d-978f-479a10090dbd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:35:59.366687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b2efa2db-5008-452d-978f-479a10090dbd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.175980 Jul 21 06:35:59.367245 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 438/863] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:35:59 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:00.249387 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5be5f139-9f8a-4ed8-9825-4965722117a1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:00.249916 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5be5f139-9f8a-4ed8-9825-4965722117a1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:00.256448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5be5f139-9f8a-4ed8-9825-4965722117a1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:00.256931 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5be5f139-9f8a-4ed8-9825-4965722117a1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:00.257692 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5be5f139-9f8a-4ed8-9825-4965722117a1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:00.258168 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5be5f139-9f8a-4ed8-9825-4965722117a1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:00.361128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:00.361743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:00.364290 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:00.369623 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:00.370098 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:00.370859 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:00.371871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:00.389346 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5be5f139-9f8a-4ed8-9825-4965722117a1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:00.397051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5be5f139-9f8a-4ed8-9825-4965722117a1 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.152326 Jul 21 06:36:00.397631 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 426/864] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:00 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:00.402427 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ca527038-a4d8-4d3a-88bc-71a85d3518f4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:00.403275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ca527038-a4d8-4d3a-88bc-71a85d3518f4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:00.407426 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:00.407873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:00.408318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lazy-loading 'fault' on Instance uuid 3dd12a96-a6ba-4881-9e69-20771a9b2d91 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:36:00.409003 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ca527038-a4d8-4d3a-88bc-71a85d3518f4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:00.409460 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ca527038-a4d8-4d3a-88bc-71a85d3518f4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:00.410258 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ca527038-a4d8-4d3a-88bc-71a85d3518f4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:00.410699 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ca527038-a4d8-4d3a-88bc-71a85d3518f4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:00.410987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:00.456003 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:00.463498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-149519ef-282d-4d96-99f6-368f613f9b8e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 200 len: 1231 microversion: 2.1 time: 0.106219 Jul 21 06:36:00.464053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 439/865] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:00 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:00.550596 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ca527038-a4d8-4d3a-88bc-71a85d3518f4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:00.557782 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ca527038-a4d8-4d3a-88bc-71a85d3518f4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.159158 Jul 21 06:36:00.558373 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 427/866] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:00 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:01.414166 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dce73150-efc1-44c5-8f12-70a98a0c99bd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:01.414803 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dce73150-efc1-44c5-8f12-70a98a0c99bd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:01.421772 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dce73150-efc1-44c5-8f12-70a98a0c99bd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:01.422791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dce73150-efc1-44c5-8f12-70a98a0c99bd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:01.423008 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dce73150-efc1-44c5-8f12-70a98a0c99bd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:01.423466 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dce73150-efc1-44c5-8f12-70a98a0c99bd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:01.480182 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9880f6ec-618c-4eb2-9354-1ec0f37bcf31 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:01.480957 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9880f6ec-618c-4eb2-9354-1ec0f37bcf31 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:01.487981 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9880f6ec-618c-4eb2-9354-1ec0f37bcf31 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:01.488434 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9880f6ec-618c-4eb2-9354-1ec0f37bcf31 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:01.489238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9880f6ec-618c-4eb2-9354-1ec0f37bcf31 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:01.489701 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9880f6ec-618c-4eb2-9354-1ec0f37bcf31 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:01.505533 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-9880f6ec-618c-4eb2-9354-1ec0f37bcf31 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] HTTP exception thrown: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9880f6ec-618c-4eb2-9354-1ec0f37bcf31 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Request method failure captured: Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 HTTP/1.1 Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PLm9tyySK3qJdzYT6hnN2CdZPsJRJ_srIoWVYVHjPBG5rb1xeBaPlAmOzFhEGU5qwtncWPLsnEJTD8pTLqWTI0xbRFigUga3R9RzBdl5uQ_pk_gVWvAtA82phdiMS8zDSEsu3Ch2ovjw4IimaPa2loVLkelL01NSiAylyZiNKZVd_E Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: 5d0ba27e9a7f450c87eb189cdd6e235b Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:36:01.507292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d0ba27e9a7f450c87eb189cdd6e235b"}]}] Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: 5d0ba27e9a7f450c87eb189cdd6e235b Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-TestVolumeBootPattern-1839744956-project Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 5439d1a65154486bb4fdfeeaf8ab4b07 Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-TestVolumeBootPattern-1839744956-project Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:36:01.508868 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '3dd12a96-a6ba-4881-9e69-20771a9b2d91'} Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:36:01.509740 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:36:01.511321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:36:01.513358 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9880f6ec-618c-4eb2-9354-1ec0f37bcf31 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Returning 404 to user: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:36:01.513358 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9880f6ec-618c-4eb2-9354-1ec0f37bcf31 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 404 len: 111 microversion: 2.1 time: 0.032559 Jul 21 06:36:01.513358 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 428/867] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:01 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:36:01.574203 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-76831bb3-ae4b-45ff-8589-df147608714e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:01.575819 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-76831bb3-ae4b-45ff-8589-df147608714e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:01.582690 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76831bb3-ae4b-45ff-8589-df147608714e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:01.583150 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76831bb3-ae4b-45ff-8589-df147608714e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:01.583932 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76831bb3-ae4b-45ff-8589-df147608714e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:01.584373 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76831bb3-ae4b-45ff-8589-df147608714e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:01.785079 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dce73150-efc1-44c5-8f12-70a98a0c99bd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:01.788845 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-76831bb3-ae4b-45ff-8589-df147608714e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:01.792856 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dce73150-efc1-44c5-8f12-70a98a0c99bd tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1523 microversion: 2.1 time: 0.382574 Jul 21 06:36:01.794749 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 440/868] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:01 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1523 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:01.796934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-76831bb3-ae4b-45ff-8589-df147608714e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.226683 Jul 21 06:36:01.797667 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 429/869] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:01 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:01.799251 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1890023807", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1128193888", "security_groups": [{"name": "tempest-secgroup-smoke-771985638"}], "block_device_mapping_v2": [{"uuid": "0ab52c86-8cd7-4179-89fa-9ce0fc73ff47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dadad058-4314-4199-8e9f-a1bda80f561d"}]}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:01.909329 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] validate_networks() for [('dadad058-4314-4199-8e9f-a1bda80f561d', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:36:02.695904 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-f432c2f1-abe8-4607-96a7-473ba36152e8 req-04cc2387-4253-46a6-964b-8fac2b22756b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746e5366-e38d-4694-b0dc-5d71af0c69d3", "name": "network-vif-deleted", "tag": "066e9645-9422-4d88-a511-31ab25daf6de"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:02.705140 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-f432c2f1-abe8-4607-96a7-473ba36152e8 req-04cc2387-4253-46a6-964b-8fac2b22756b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:02.705582 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-f432c2f1-abe8-4607-96a7-473ba36152e8 req-04cc2387-4253-46a6-964b-8fac2b22756b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:02.719642 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-f432c2f1-abe8-4607-96a7-473ba36152e8 req-04cc2387-4253-46a6-964b-8fac2b22756b service nova] Creating event network-vif-deleted:066e9645-9422-4d88-a511-31ab25daf6de for instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 on hv-cinder-85031 Jul 21 06:36:02.724413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-f432c2f1-abe8-4607-96a7-473ba36152e8 req-04cc2387-4253-46a6-964b-8fac2b22756b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134073 Jul 21 06:36:02.725009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 430/870] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:36:02.812300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:02.813167 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:02.819677 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:02.820414 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:02.821284 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:02.821832 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:02.830479 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:36:02.830957 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:36:02.831393 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:36:02.831789 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:36:02.832209 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:36:02.841794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:02.842352 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:02.843084 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:02.843719 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:02.856381 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:02.856924 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:02.857444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lazy-loading 'fault' on Instance uuid 746e5366-e38d-4694-b0dc-5d71af0c69d3 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:36:02.861640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Getting quotas for project 5d0ba27e9a7f450c87eb189cdd6e235b. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:36:02.866044 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Getting quotas for user 5439d1a65154486bb4fdfeeaf8ab4b07 and project 5d0ba27e9a7f450c87eb189cdd6e235b. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:36:02.905388 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774dd66c674a4955a439afd30354efab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd8a1a642a24b519aefdde9ed336536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:02.914422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e30bc35d-06c9-4780-a13c-89d21d067aef tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 200 len: 1312 microversion: 2.1 time: 0.106898 Jul 21 06:36:02.915115 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 431/871] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:02 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:02.920092 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5c732453-0e86-40cd-8129-d67be21c3093 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:02.920925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5c732453-0e86-40cd-8129-d67be21c3093 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:02.927916 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5c732453-0e86-40cd-8129-d67be21c3093 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:02.928460 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5c732453-0e86-40cd-8129-d67be21c3093 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:02.929246 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5c732453-0e86-40cd-8129-d67be21c3093 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:02.929592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5c732453-0e86-40cd-8129-d67be21c3093 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:02.945633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:36:02.947787 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ab52c86-8cd7-4179-89fa-9ce0fc73ff47',volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:36:03.111308 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-cc1853a5-16a2-45fd-8130-2e782b288a61 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.315719 Jul 21 06:36:03.117056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 441/872] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:36:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:36:03.122601 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d21ea62c-764f-4dce-9cde-1ebae87cb1ca tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:03.123142 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d21ea62c-764f-4dce-9cde-1ebae87cb1ca tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:03.145150 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5c732453-0e86-40cd-8129-d67be21c3093 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:03.156555 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5c732453-0e86-40cd-8129-d67be21c3093 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.240140 Jul 21 06:36:03.157146 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 432/873] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:02 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:03.192723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d21ea62c-764f-4dce-9cde-1ebae87cb1ca tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:03.202253 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d21ea62c-764f-4dce-9cde-1ebae87cb1ca tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1095 microversion: 2.1 time: 0.083792 Jul 21 06:36:03.202847 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 442/874] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:03 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:03.930999 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-da3a8e72-18f4-4f0e-92ca-22aec21e4272 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:03.931623 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-da3a8e72-18f4-4f0e-92ca-22aec21e4272 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] [instance: 746e5366-e38d-4694-b0dc-5d71af0c69d3] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:03.938331 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-da3a8e72-18f4-4f0e-92ca-22aec21e4272 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:03.938795 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-da3a8e72-18f4-4f0e-92ca-22aec21e4272 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:03.939572 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-da3a8e72-18f4-4f0e-92ca-22aec21e4272 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:03.940015 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-da3a8e72-18f4-4f0e-92ca-22aec21e4272 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:03.954771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-da3a8e72-18f4-4f0e-92ca-22aec21e4272 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] HTTP exception thrown: Instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 could not be found. Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-da3a8e72-18f4-4f0e-92ca-22aec21e4272 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Request method failure captured: Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 HTTP/1.1 Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PJ-FFa9px1qCFnQ_sVPIFJANLwiQsrfzGqBK9nRcF_7iLo1GNYjYZxw0dARm7jCwmHAsciC1YM2eh222mYLJQw7VTxzlGyzWumMt_LTTamWiA7oArJUmVZuWCK9D7wzeppFw1Lud6bU_EHLtCwlZMUAtguGU1smt37yBYtT3R5G4sQ Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: 9cd8a1a642a24b519aefdde9ed336536 Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:36:03.964424 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cd8a1a642a24b519aefdde9ed336536"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9cd8a1a642a24b519aefdde9ed336536"}]}] Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: 9cd8a1a642a24b519aefdde9ed336536 Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1302720953 Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-ServerRescueNegativeTestJSON-1302720953-project Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 774dd66c674a4955a439afd30354efab Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1302720953-project Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 could not be found. Jul 21 06:36:03.968078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '746e5366-e38d-4694-b0dc-5d71af0c69d3'} Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 could not be found. Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:36:03.969244 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 could not be found. Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 could not be found. Jul 21 06:36:03.970975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:36:03.972219 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-da3a8e72-18f4-4f0e-92ca-22aec21e4272 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] Returning 404 to user: Instance 746e5366-e38d-4694-b0dc-5d71af0c69d3 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:36:03.972219 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-da3a8e72-18f4-4f0e-92ca-22aec21e4272 tempest-ServerRescueNegativeTestJSON-1302720953 tempest-ServerRescueNegativeTestJSON-1302720953-project] 10.222.0.42 "GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3" status: 404 len: 111 microversion: 2.1 time: 0.030972 Jul 21 06:36:03.972219 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 433/875] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:03 2022] GET /compute/v2.1/servers/746e5366-e38d-4694-b0dc-5d71af0c69d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:36:04.174736 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f4093e02-6079-441c-979c-bf6560f0b8db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:04.175306 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f4093e02-6079-441c-979c-bf6560f0b8db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:04.183187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4093e02-6079-441c-979c-bf6560f0b8db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:04.183650 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4093e02-6079-441c-979c-bf6560f0b8db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:04.184566 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4093e02-6079-441c-979c-bf6560f0b8db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:04.185028 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f4093e02-6079-441c-979c-bf6560f0b8db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:04.220152 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-91382c53-f49a-4268-a973-7d39d66b7e9b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:04.220878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-91382c53-f49a-4268-a973-7d39d66b7e9b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:04.227348 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-91382c53-f49a-4268-a973-7d39d66b7e9b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:04.228044 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-91382c53-f49a-4268-a973-7d39d66b7e9b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:04.228830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-91382c53-f49a-4268-a973-7d39d66b7e9b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:04.229330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-91382c53-f49a-4268-a973-7d39d66b7e9b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:04.361762 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-91382c53-f49a-4268-a973-7d39d66b7e9b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:04.372620 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-91382c53-f49a-4268-a973-7d39d66b7e9b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1211 microversion: 2.1 time: 0.157296 Jul 21 06:36:04.374839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 434/876] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:04 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:04.548856 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f4093e02-6079-441c-979c-bf6560f0b8db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:04.556485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f4093e02-6079-441c-979c-bf6560f0b8db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.385893 Jul 21 06:36:04.566655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 443/877] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:04 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:05.391279 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-bc9525ee-ff9a-4b34-8dff-4e27b9430a10 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:05.391903 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-bc9525ee-ff9a-4b34-8dff-4e27b9430a10 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:05.399067 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc9525ee-ff9a-4b34-8dff-4e27b9430a10 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:05.399521 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc9525ee-ff9a-4b34-8dff-4e27b9430a10 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:05.400307 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc9525ee-ff9a-4b34-8dff-4e27b9430a10 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:05.400752 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc9525ee-ff9a-4b34-8dff-4e27b9430a10 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:05.573370 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bc8ed24a-e606-4567-9deb-1d8cc9065785 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:05.574167 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bc8ed24a-e606-4567-9deb-1d8cc9065785 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:05.581313 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc8ed24a-e606-4567-9deb-1d8cc9065785 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:05.581760 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc8ed24a-e606-4567-9deb-1d8cc9065785 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:05.582546 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc8ed24a-e606-4567-9deb-1d8cc9065785 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:05.582977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bc8ed24a-e606-4567-9deb-1d8cc9065785 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:05.619781 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bc9525ee-ff9a-4b34-8dff-4e27b9430a10 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:05.629158 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-bc9525ee-ff9a-4b34-8dff-4e27b9430a10 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1199 microversion: 2.1 time: 0.241948 Jul 21 06:36:05.629735 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 435/878] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:05 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1199 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:05.848163 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bc8ed24a-e606-4567-9deb-1d8cc9065785 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:05.856158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bc8ed24a-e606-4567-9deb-1d8cc9065785 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.286076 Jul 21 06:36:05.856918 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 444/879] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:05 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:06.646529 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5da8f729-c730-46d9-ac7b-08eaf7229fc9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:06.647158 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5da8f729-c730-46d9-ac7b-08eaf7229fc9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:06.654905 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5da8f729-c730-46d9-ac7b-08eaf7229fc9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:06.655359 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5da8f729-c730-46d9-ac7b-08eaf7229fc9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:06.656340 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5da8f729-c730-46d9-ac7b-08eaf7229fc9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:06.656784 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5da8f729-c730-46d9-ac7b-08eaf7229fc9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:06.872112 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5da8f729-c730-46d9-ac7b-08eaf7229fc9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:06.874761 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-349dcc49-6d17-43a1-b83c-98faf3fbdc89 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:06.875943 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-349dcc49-6d17-43a1-b83c-98faf3fbdc89 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:06.884428 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-349dcc49-6d17-43a1-b83c-98faf3fbdc89 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:06.885287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-349dcc49-6d17-43a1-b83c-98faf3fbdc89 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:06.886475 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-349dcc49-6d17-43a1-b83c-98faf3fbdc89 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:06.888341 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-349dcc49-6d17-43a1-b83c-98faf3fbdc89 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:06.892680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5da8f729-c730-46d9-ac7b-08eaf7229fc9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.248435 Jul 21 06:36:06.899455 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 436/880] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:06 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:07.111701 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-349dcc49-6d17-43a1-b83c-98faf3fbdc89 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:07.119589 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-349dcc49-6d17-43a1-b83c-98faf3fbdc89 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.250391 Jul 21 06:36:07.130037 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 445/881] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:06 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:07.912939 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-789afbe8-7b59-4799-ba68-98293e72c791 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:07.914281 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-789afbe8-7b59-4799-ba68-98293e72c791 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:07.921768 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-789afbe8-7b59-4799-ba68-98293e72c791 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:07.922489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-789afbe8-7b59-4799-ba68-98293e72c791 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:07.923329 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-789afbe8-7b59-4799-ba68-98293e72c791 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:07.923850 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-789afbe8-7b59-4799-ba68-98293e72c791 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:08.136806 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-112048b8-2af7-44a7-8902-d24995a411a7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:08.138733 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-112048b8-2af7-44a7-8902-d24995a411a7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:08.150436 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-112048b8-2af7-44a7-8902-d24995a411a7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:08.150950 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-112048b8-2af7-44a7-8902-d24995a411a7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:08.151789 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-112048b8-2af7-44a7-8902-d24995a411a7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:08.152237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-112048b8-2af7-44a7-8902-d24995a411a7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:08.212439 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-789afbe8-7b59-4799-ba68-98293e72c791 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:08.235783 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-789afbe8-7b59-4799-ba68-98293e72c791 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.326509 Jul 21 06:36:08.236557 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 437/882] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:07 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:08.443352 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-112048b8-2af7-44a7-8902-d24995a411a7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:08.457705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-112048b8-2af7-44a7-8902-d24995a411a7 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.324855 Jul 21 06:36:08.458348 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 446/883] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:08 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:09.254574 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dcf68e96-6915-4bb5-b9ae-a8298b23f573 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:09.255884 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dcf68e96-6915-4bb5-b9ae-a8298b23f573 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:09.264170 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dcf68e96-6915-4bb5-b9ae-a8298b23f573 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:09.264625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dcf68e96-6915-4bb5-b9ae-a8298b23f573 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:09.265407 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dcf68e96-6915-4bb5-b9ae-a8298b23f573 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:09.265837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dcf68e96-6915-4bb5-b9ae-a8298b23f573 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:09.277241 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-4692a8eb-1217-4cea-a71f-f1a9d2c7a6f4 req-35c66883-f2f4-42b9-841c-cab986a2818e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9015b69f-c621-4156-a5c9-94bfc3f3b41c", "tag": "fe87d5c2-e7cb-44a8-bcf1-7d5b938d8647"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:09.295326 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-4692a8eb-1217-4cea-a71f-f1a9d2c7a6f4 req-35c66883-f2f4-42b9-841c-cab986a2818e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:09.295875 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-4692a8eb-1217-4cea-a71f-f1a9d2c7a6f4 req-35c66883-f2f4-42b9-841c-cab986a2818e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:09.314368 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-4692a8eb-1217-4cea-a71f-f1a9d2c7a6f4 req-35c66883-f2f4-42b9-841c-cab986a2818e service nova] Creating event network-changed:fe87d5c2-e7cb-44a8-bcf1-7d5b938d8647 for instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c on hv-cinder-85031 Jul 21 06:36:09.320941 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-4692a8eb-1217-4cea-a71f-f1a9d2c7a6f4 req-35c66883-f2f4-42b9-841c-cab986a2818e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331128 Jul 21 06:36:09.322106 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 438/884] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:09.475482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-acfe1d5a-baed-4fa6-8947-23da6b9ff0ef tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:09.476193 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-acfe1d5a-baed-4fa6-8947-23da6b9ff0ef tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:09.483550 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-acfe1d5a-baed-4fa6-8947-23da6b9ff0ef tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:09.484008 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-acfe1d5a-baed-4fa6-8947-23da6b9ff0ef tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:09.484955 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-acfe1d5a-baed-4fa6-8947-23da6b9ff0ef tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:09.485901 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-acfe1d5a-baed-4fa6-8947-23da6b9ff0ef tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:09.525864 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dcf68e96-6915-4bb5-b9ae-a8298b23f573 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:09.536139 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dcf68e96-6915-4bb5-b9ae-a8298b23f573 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.286602 Jul 21 06:36:09.536812 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 447/885] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:09 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:09.686285 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-acfe1d5a-baed-4fa6-8947-23da6b9ff0ef tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:09.695652 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-acfe1d5a-baed-4fa6-8947-23da6b9ff0ef tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.224295 Jul 21 06:36:09.696527 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 439/886] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:09 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:10.481119 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-7b2810ac-3247-4b4b-bd39-9b865dc51f01 req-abeb0f05-bebf-464d-a489-3ba6c35b36de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efabe894-210e-4604-a672-71967b164f19", "name": "network-vif-plugged", "status": "completed", "tag": "1f2280ad-29cb-4bee-9cdc-eda920400b0c"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:10.491635 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-7b2810ac-3247-4b4b-bd39-9b865dc51f01 req-abeb0f05-bebf-464d-a489-3ba6c35b36de service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:10.492082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-7b2810ac-3247-4b4b-bd39-9b865dc51f01 req-abeb0f05-bebf-464d-a489-3ba6c35b36de service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:10.505812 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-7b2810ac-3247-4b4b-bd39-9b865dc51f01 req-abeb0f05-bebf-464d-a489-3ba6c35b36de service nova] Creating event network-vif-plugged:1f2280ad-29cb-4bee-9cdc-eda920400b0c for instance efabe894-210e-4604-a672-71967b164f19 on hv-cinder-85031 Jul 21 06:36:10.511414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-7b2810ac-3247-4b4b-bd39-9b865dc51f01 req-abeb0f05-bebf-464d-a489-3ba6c35b36de service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254889 Jul 21 06:36:10.512978 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 448/887] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:10.554068 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f6c81890-cd25-4202-b2ed-d5266e84a71d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:10.554714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f6c81890-cd25-4202-b2ed-d5266e84a71d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:10.572614 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f6c81890-cd25-4202-b2ed-d5266e84a71d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:10.573282 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f6c81890-cd25-4202-b2ed-d5266e84a71d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:10.575471 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f6c81890-cd25-4202-b2ed-d5266e84a71d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:10.576122 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f6c81890-cd25-4202-b2ed-d5266e84a71d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:10.578048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e25826d6-559e-4e52-93fd-53fa13fd149e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:10.578562 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e25826d6-559e-4e52-93fd-53fa13fd149e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:10.585684 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e25826d6-559e-4e52-93fd-53fa13fd149e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:10.586429 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e25826d6-559e-4e52-93fd-53fa13fd149e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:10.587415 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e25826d6-559e-4e52-93fd-53fa13fd149e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:10.588018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e25826d6-559e-4e52-93fd-53fa13fd149e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:10.617084 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e25826d6-559e-4e52-93fd-53fa13fd149e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/ips" status: 200 len: 151 microversion: 2.1 time: 0.241959 Jul 21 06:36:10.617656 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 440/888] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 06:36:10 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/ips => generated 151 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:10.714809 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6fe017e7-43e1-4ed3-aea4-de4ac8959246 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:10.716267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6fe017e7-43e1-4ed3-aea4-de4ac8959246 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:10.724594 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6fe017e7-43e1-4ed3-aea4-de4ac8959246 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:10.725089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6fe017e7-43e1-4ed3-aea4-de4ac8959246 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:10.726445 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6fe017e7-43e1-4ed3-aea4-de4ac8959246 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:10.727378 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6fe017e7-43e1-4ed3-aea4-de4ac8959246 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:10.839942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f6c81890-cd25-4202-b2ed-d5266e84a71d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:10.850638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f6c81890-cd25-4202-b2ed-d5266e84a71d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.301515 Jul 21 06:36:10.851211 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 449/889] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:10 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:11.014461 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6fe017e7-43e1-4ed3-aea4-de4ac8959246 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:11.022511 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6fe017e7-43e1-4ed3-aea4-de4ac8959246 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.313704 Jul 21 06:36:11.023097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 441/890] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:10 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:11.867581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-48771736-97a1-420a-bab0-22f2e5080511 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:11.873979 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-48771736-97a1-420a-bab0-22f2e5080511 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:11.883108 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-48771736-97a1-420a-bab0-22f2e5080511 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:11.884204 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-48771736-97a1-420a-bab0-22f2e5080511 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:11.885552 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-48771736-97a1-420a-bab0-22f2e5080511 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:11.888159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-48771736-97a1-420a-bab0-22f2e5080511 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:12.041063 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0265b2c3-6eef-46ef-b37d-83de9f82943b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:12.041693 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0265b2c3-6eef-46ef-b37d-83de9f82943b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:12.045151 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-48771736-97a1-420a-bab0-22f2e5080511 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:12.057133 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0265b2c3-6eef-46ef-b37d-83de9f82943b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:12.057133 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0265b2c3-6eef-46ef-b37d-83de9f82943b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:12.057854 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0265b2c3-6eef-46ef-b37d-83de9f82943b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:12.058368 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0265b2c3-6eef-46ef-b37d-83de9f82943b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:12.063902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:12.065166 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-48771736-97a1-420a-bab0-22f2e5080511 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.200297 Jul 21 06:36:12.065773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 450/891] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:11 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:12.091592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ef531c13-942d-40cd-ae32-4560908473c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1c7bd29-980a-4355-bc01-aeefa2dc3f74"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:12.092792 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ef531c13-942d-40cd-ae32-4560908473c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:12.099440 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef531c13-942d-40cd-ae32-4560908473c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:12.100031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef531c13-942d-40cd-ae32-4560908473c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:12.100970 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef531c13-942d-40cd-ae32-4560908473c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:12.101553 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ef531c13-942d-40cd-ae32-4560908473c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:12.213680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0265b2c3-6eef-46ef-b37d-83de9f82943b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:12.224152 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0265b2c3-6eef-46ef-b37d-83de9f82943b tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1364 microversion: 2.1 time: 0.187188 Jul 21 06:36:12.224724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 442/892] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:12 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:12.710387 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ef531c13-942d-40cd-ae32-4560908473c6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.622891 Jul 21 06:36:12.711166 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 451/893] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:36:12 2022] POST /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:13.081396 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-61a21299-d21f-40fd-b4fa-90df8c33173e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:13.082134 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-61a21299-d21f-40fd-b4fa-90df8c33173e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:13.088769 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-61a21299-d21f-40fd-b4fa-90df8c33173e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:13.089224 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-61a21299-d21f-40fd-b4fa-90df8c33173e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:13.090204 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-61a21299-d21f-40fd-b4fa-90df8c33173e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:13.090625 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-61a21299-d21f-40fd-b4fa-90df8c33173e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:13.238661 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:13.240654 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=8 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:13.242304 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-61a21299-d21f-40fd-b4fa-90df8c33173e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:13.245914 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9b1b4106-a344-4094-8d30-78a212e6ff0f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:13.247672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9b1b4106-a344-4094-8d30-78a212e6ff0f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:13.254139 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b1b4106-a344-4094-8d30-78a212e6ff0f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:13.254588 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b1b4106-a344-4094-8d30-78a212e6ff0f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:13.255640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b1b4106-a344-4094-8d30-78a212e6ff0f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:13.256246 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9b1b4106-a344-4094-8d30-78a212e6ff0f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:13.256613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-61a21299-d21f-40fd-b4fa-90df8c33173e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.178795 Jul 21 06:36:13.257222 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 443/894] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:13 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:13.427861 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9b1b4106-a344-4094-8d30-78a212e6ff0f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:13.440035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9b1b4106-a344-4094-8d30-78a212e6ff0f tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1550 microversion: 2.1 time: 0.202795 Jul 21 06:36:13.441093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 452/895] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:13 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1550 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:13.460326 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ef3e15b0-5ce1-45ac-a30c-6188ff64571d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:13.460326 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ef3e15b0-5ce1-45ac-a30c-6188ff64571d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:13.466866 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ef3e15b0-5ce1-45ac-a30c-6188ff64571d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:13.467519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ef3e15b0-5ce1-45ac-a30c-6188ff64571d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:13.468516 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ef3e15b0-5ce1-45ac-a30c-6188ff64571d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:13.468860 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ef3e15b0-5ce1-45ac-a30c-6188ff64571d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:13.576569 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ef3e15b0-5ce1-45ac-a30c-6188ff64571d tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121917 Jul 21 06:36:13.577179 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 444/896] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 06:36:13 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:14.276607 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b1a8434d-b68f-4a3d-86ac-9c9e11a357e4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:14.278260 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b1a8434d-b68f-4a3d-86ac-9c9e11a357e4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:14.285313 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1a8434d-b68f-4a3d-86ac-9c9e11a357e4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:14.285814 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1a8434d-b68f-4a3d-86ac-9c9e11a357e4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:14.286626 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1a8434d-b68f-4a3d-86ac-9c9e11a357e4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:14.287069 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1a8434d-b68f-4a3d-86ac-9c9e11a357e4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:14.422095 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b1a8434d-b68f-4a3d-86ac-9c9e11a357e4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:14.429538 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b1a8434d-b68f-4a3d-86ac-9c9e11a357e4 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.157057 Jul 21 06:36:14.430315 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 453/897] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:14 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:14.778799 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-d921774c-cc6d-4df6-a090-ad5bda3a8a53 req-027fa9ae-30d6-4408-ac79-bb0a307d00ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efabe894-210e-4604-a672-71967b164f19", "tag": "1f2280ad-29cb-4bee-9cdc-eda920400b0c"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:14.787073 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-d921774c-cc6d-4df6-a090-ad5bda3a8a53 req-027fa9ae-30d6-4408-ac79-bb0a307d00ff service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:14.787525 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-d921774c-cc6d-4df6-a090-ad5bda3a8a53 req-027fa9ae-30d6-4408-ac79-bb0a307d00ff service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:14.799686 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-d921774c-cc6d-4df6-a090-ad5bda3a8a53 req-027fa9ae-30d6-4408-ac79-bb0a307d00ff service nova] Creating event network-changed:1f2280ad-29cb-4bee-9cdc-eda920400b0c for instance efabe894-210e-4604-a672-71967b164f19 on hv-cinder-85031 Jul 21 06:36:14.804695 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-d921774c-cc6d-4df6-a090-ad5bda3a8a53 req-027fa9ae-30d6-4408-ac79-bb0a307d00ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031240 Jul 21 06:36:14.805478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 445/898] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:15.447366 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ab0fedde-3a00-400f-911a-ea933a599114 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:15.447999 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ab0fedde-3a00-400f-911a-ea933a599114 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:15.454991 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ab0fedde-3a00-400f-911a-ea933a599114 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:15.455446 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ab0fedde-3a00-400f-911a-ea933a599114 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:15.456229 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ab0fedde-3a00-400f-911a-ea933a599114 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:15.456680 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ab0fedde-3a00-400f-911a-ea933a599114 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:15.598223 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ab0fedde-3a00-400f-911a-ea933a599114 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:15.607327 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ab0fedde-3a00-400f-911a-ea933a599114 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.162777 Jul 21 06:36:15.607902 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 454/899] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:15 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:16.628678 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-fc628aae-964c-44fe-bae6-b01972476f8f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:16.629591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-fc628aae-964c-44fe-bae6-b01972476f8f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:16.638870 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc628aae-964c-44fe-bae6-b01972476f8f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:16.639317 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc628aae-964c-44fe-bae6-b01972476f8f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:16.640118 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc628aae-964c-44fe-bae6-b01972476f8f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:16.640741 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-fc628aae-964c-44fe-bae6-b01972476f8f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:16.832716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-fc628aae-964c-44fe-bae6-b01972476f8f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:16.841354 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-fc628aae-964c-44fe-bae6-b01972476f8f tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.220321 Jul 21 06:36:16.850965 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 446/900] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:16 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:17.858688 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d7dfa4d4-e160-4b39-a96c-81dbfae05612 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:17.859849 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d7dfa4d4-e160-4b39-a96c-81dbfae05612 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:17.867717 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d7dfa4d4-e160-4b39-a96c-81dbfae05612 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:17.868168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d7dfa4d4-e160-4b39-a96c-81dbfae05612 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:17.869061 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d7dfa4d4-e160-4b39-a96c-81dbfae05612 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:17.869584 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d7dfa4d4-e160-4b39-a96c-81dbfae05612 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:18.009435 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d7dfa4d4-e160-4b39-a96c-81dbfae05612 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:18.018027 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d7dfa4d4-e160-4b39-a96c-81dbfae05612 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.164693 Jul 21 06:36:18.018598 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 455/901] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:17 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:18.299694 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-6fd09d69-f3b1-45b3-8f64-204cc1692a86 req-14e3d62f-70dc-4ff9-92e6-e73c1788f60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9015b69f-c621-4156-a5c9-94bfc3f3b41c", "name": "network-vif-plugged", "status": "completed", "tag": "fe87d5c2-e7cb-44a8-bcf1-7d5b938d8647"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:18.312076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-6fd09d69-f3b1-45b3-8f64-204cc1692a86 req-14e3d62f-70dc-4ff9-92e6-e73c1788f60a service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:18.312982 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-6fd09d69-f3b1-45b3-8f64-204cc1692a86 req-14e3d62f-70dc-4ff9-92e6-e73c1788f60a service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:18.332881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-6fd09d69-f3b1-45b3-8f64-204cc1692a86 req-14e3d62f-70dc-4ff9-92e6-e73c1788f60a service nova] Creating event network-vif-plugged:fe87d5c2-e7cb-44a8-bcf1-7d5b938d8647 for instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c on hv-cinder-85031 Jul 21 06:36:18.338441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-6fd09d69-f3b1-45b3-8f64-204cc1692a86 req-14e3d62f-70dc-4ff9-92e6-e73c1788f60a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042492 Jul 21 06:36:18.340350 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 447/902] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:36:19.034417 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d2b08c57-ecb9-4148-98ac-a84d86572fee tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:19.035038 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d2b08c57-ecb9-4148-98ac-a84d86572fee tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:19.042300 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d2b08c57-ecb9-4148-98ac-a84d86572fee tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:19.043010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d2b08c57-ecb9-4148-98ac-a84d86572fee tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:19.044473 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d2b08c57-ecb9-4148-98ac-a84d86572fee tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:19.045093 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d2b08c57-ecb9-4148-98ac-a84d86572fee tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:19.228407 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d2b08c57-ecb9-4148-98ac-a84d86572fee tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:19.236903 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d2b08c57-ecb9-4148-98ac-a84d86572fee tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.206259 Jul 21 06:36:19.247000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 456/903] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:19 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:20.254301 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7b8cf77b-e363-4b09-bee3-bf816379fe9e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:20.255831 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7b8cf77b-e363-4b09-bee3-bf816379fe9e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:20.264818 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7b8cf77b-e363-4b09-bee3-bf816379fe9e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:20.265518 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7b8cf77b-e363-4b09-bee3-bf816379fe9e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:20.266477 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7b8cf77b-e363-4b09-bee3-bf816379fe9e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:20.267091 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7b8cf77b-e363-4b09-bee3-bf816379fe9e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:20.300908 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-084714e9-543d-488e-aab5-ebb8294c4086 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1c7bd29-980a-4355-bc01-aeefa2dc3f74"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:20.302057 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-084714e9-543d-488e-aab5-ebb8294c4086 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:20.315592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-084714e9-543d-488e-aab5-ebb8294c4086 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:20.316436 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-084714e9-543d-488e-aab5-ebb8294c4086 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:20.317361 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-084714e9-543d-488e-aab5-ebb8294c4086 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:20.317863 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-084714e9-543d-488e-aab5-ebb8294c4086 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:20.322210 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:20.415681 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-084714e9-543d-488e-aab5-ebb8294c4086 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Invalid volume: volume f1c7bd29-980a-4355-bc01-aeefa2dc3f74 is already attached to instances: dd58c058-dd88-4697-8b77-c6e64e146c12 Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-084714e9-543d-488e-aab5-ebb8294c4086 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: POST /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments HTTP/1.1 Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 74 Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:36:20.417851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {"volumeAttachment": {"volumeId": "f1c7bd29-980a-4355-bc01-aeefa2dc3f74"}} Jul 21 06:36:20.420136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Invalid volume: volume f1c7bd29-980a-4355-bc01-aeefa2dc3f74 is already attached to instances: dd58c058-dd88-4697-8b77-c6e64e146c12 Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'server_id': 'dd58c058-dd88-4697-8b77-c6e64e146c12', 'body': {'volumeAttachment': {'volumeId': 'f1c7bd29-980a-4355-bc01-aeefa2dc3f74'}}} Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f1c7bd29-980a-4355-bc01-aeefa2dc3f74 is already attached to instances: dd58c058-dd88-4697-8b77-c6e64e146c12 Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:36:20.421042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f1c7bd29-980a-4355-bc01-aeefa2dc3f74 is already attached to instances: dd58c058-dd88-4697-8b77-c6e64e146c12 Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:20.422497 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:36:20.423758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:36:20.423758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:36:20.423758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:36:20.423758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f1c7bd29-980a-4355-bc01-aeefa2dc3f74 is already attached to instances: dd58c058-dd88-4697-8b77-c6e64e146c12 Jul 21 06:36:20.423758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:36:20.424812 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7b8cf77b-e363-4b09-bee3-bf816379fe9e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:20.425845 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-084714e9-543d-488e-aab5-ebb8294c4086 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 400 to user: Invalid volume: volume f1c7bd29-980a-4355-bc01-aeefa2dc3f74 is already attached to instances: dd58c058-dd88-4697-8b77-c6e64e146c12 {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:36:20.426976 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-084714e9-543d-488e-aab5-ebb8294c4086 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.130191 Jul 21 06:36:20.431114 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 457/904] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:36:20 2022] POST /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments => generated 174 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 06:36:20.434590 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7b8cf77b-e363-4b09-bee3-bf816379fe9e tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1266 microversion: 2.1 time: 0.183864 Jul 21 06:36:20.435845 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 448/905] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:20 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:20.501772 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5061fc7f-4cfa-4e1f-aacc-b0419ba0c805 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:20.502306 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5061fc7f-4cfa-4e1f-aacc-b0419ba0c805 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:20.508916 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5061fc7f-4cfa-4e1f-aacc-b0419ba0c805 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:20.513422 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5061fc7f-4cfa-4e1f-aacc-b0419ba0c805 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:20.514544 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5061fc7f-4cfa-4e1f-aacc-b0419ba0c805 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:20.514989 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5061fc7f-4cfa-4e1f-aacc-b0419ba0c805 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:20.610515 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-5061fc7f-4cfa-4e1f-aacc-b0419ba0c805 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lazy-loading 'services' on Instance uuid dd58c058-dd88-4697-8b77-c6e64e146c12 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:36:20.687288 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5061fc7f-4cfa-4e1f-aacc-b0419ba0c805 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments/f1c7bd29-980a-4355-bc01-aeefa2dc3f74" status: 202 len: 0 microversion: 2.1 time: 0.189271 Jul 21 06:36:20.688109 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 458/906] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:36:20 2022] DELETE /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments/f1c7bd29-980a-4355-bc01-aeefa2dc3f74 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 06:36:20.696614 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9e87cefb-f91f-4d2f-96e0-7775f8d330b4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:20.697555 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9e87cefb-f91f-4d2f-96e0-7775f8d330b4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:20.704751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9e87cefb-f91f-4d2f-96e0-7775f8d330b4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:20.705207 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9e87cefb-f91f-4d2f-96e0-7775f8d330b4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:20.706151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9e87cefb-f91f-4d2f-96e0-7775f8d330b4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:20.706609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9e87cefb-f91f-4d2f-96e0-7775f8d330b4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:20.741327 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9e87cefb-f91f-4d2f-96e0-7775f8d330b4 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048756 Jul 21 06:36:20.742006 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 449/907] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:36:20 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:36:21.453221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-886af848-8da7-43cf-bcc6-68902f3f8844 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:21.453954 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-886af848-8da7-43cf-bcc6-68902f3f8844 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:21.461341 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-886af848-8da7-43cf-bcc6-68902f3f8844 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:21.461816 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-886af848-8da7-43cf-bcc6-68902f3f8844 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:21.462638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-886af848-8da7-43cf-bcc6-68902f3f8844 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:21.463083 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-886af848-8da7-43cf-bcc6-68902f3f8844 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:21.607689 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-886af848-8da7-43cf-bcc6-68902f3f8844 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:21.615128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-886af848-8da7-43cf-bcc6-68902f3f8844 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1453 microversion: 2.1 time: 0.166762 Jul 21 06:36:21.615696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 459/908] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:21 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:21.632820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3ee49dc5-cf4f-46b9-ae97-362e49484f43 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:21.633460 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3ee49dc5-cf4f-46b9-ae97-362e49484f43 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:21.641337 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3ee49dc5-cf4f-46b9-ae97-362e49484f43 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:21.641787 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3ee49dc5-cf4f-46b9-ae97-362e49484f43 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:21.642724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3ee49dc5-cf4f-46b9-ae97-362e49484f43 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:21.643163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3ee49dc5-cf4f-46b9-ae97-362e49484f43 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:21.753788 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b1ca6c52-dc04-42a1-948b-12eb2f5729bc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:21.755089 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b1ca6c52-dc04-42a1-948b-12eb2f5729bc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:21.761622 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1ca6c52-dc04-42a1-948b-12eb2f5729bc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:21.762317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1ca6c52-dc04-42a1-948b-12eb2f5729bc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:21.763256 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1ca6c52-dc04-42a1-948b-12eb2f5729bc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:21.763806 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b1ca6c52-dc04-42a1-948b-12eb2f5729bc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:21.779240 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3ee49dc5-cf4f-46b9-ae97-362e49484f43 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:21.787296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3ee49dc5-cf4f-46b9-ae97-362e49484f43 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1453 microversion: 2.1 time: 0.158314 Jul 21 06:36:21.787881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 450/909] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:21 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:21.797427 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b1ca6c52-dc04-42a1-948b-12eb2f5729bc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Jul 21 06:36:21.798031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 460/910] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:36:21 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:36:22.810089 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-01890f64-a430-4078-9946-27f910afd15c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:22.811083 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-01890f64-a430-4078-9946-27f910afd15c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:22.817259 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-01890f64-a430-4078-9946-27f910afd15c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:22.817707 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-01890f64-a430-4078-9946-27f910afd15c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:22.818499 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-01890f64-a430-4078-9946-27f910afd15c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:22.818937 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-01890f64-a430-4078-9946-27f910afd15c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:22.849647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-01890f64-a430-4078-9946-27f910afd15c tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044709 Jul 21 06:36:22.850458 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 451/911] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:36:22 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:36:22.913811 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9df6543c-0d45-4a7a-9e73-892a96ff6542 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:22.914413 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9df6543c-0d45-4a7a-9e73-892a96ff6542 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:22.921881 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9df6543c-0d45-4a7a-9e73-892a96ff6542 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:22.922479 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9df6543c-0d45-4a7a-9e73-892a96ff6542 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:22.923488 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9df6543c-0d45-4a7a-9e73-892a96ff6542 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:22.924144 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9df6543c-0d45-4a7a-9e73-892a96ff6542 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:22.951504 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9df6543c-0d45-4a7a-9e73-892a96ff6542 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:36:23.031296 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9df6543c-0d45-4a7a-9e73-892a96ff6542 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 204 len: 0 microversion: 2.1 time: 0.121778 Jul 21 06:36:23.031885 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 461/912] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:36:22 2022] DELETE /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:36:23.041052 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-eec796d9-8351-4e92-b13a-4daa78bb6603 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:23.041671 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-eec796d9-8351-4e92-b13a-4daa78bb6603 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:23.048735 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-eec796d9-8351-4e92-b13a-4daa78bb6603 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:23.049263 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-eec796d9-8351-4e92-b13a-4daa78bb6603 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:23.050164 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-eec796d9-8351-4e92-b13a-4daa78bb6603 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:23.051093 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-eec796d9-8351-4e92-b13a-4daa78bb6603 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:23.182252 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-eec796d9-8351-4e92-b13a-4daa78bb6603 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:23.189811 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-eec796d9-8351-4e92-b13a-4daa78bb6603 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1684 microversion: 2.1 time: 0.153110 Jul 21 06:36:23.190413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 452/913] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:23 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:23.444802 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-f4c8cec3-c176-4a19-ab3e-e4f7337009f9 req-cea8fcd1-4e3f-4cfb-8ee4-fee068d7d93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9015b69f-c621-4156-a5c9-94bfc3f3b41c", "tag": "fe87d5c2-e7cb-44a8-bcf1-7d5b938d8647"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:23.453851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-f4c8cec3-c176-4a19-ab3e-e4f7337009f9 req-cea8fcd1-4e3f-4cfb-8ee4-fee068d7d93a service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:23.454318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-f4c8cec3-c176-4a19-ab3e-e4f7337009f9 req-cea8fcd1-4e3f-4cfb-8ee4-fee068d7d93a service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:23.465762 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-f4c8cec3-c176-4a19-ab3e-e4f7337009f9 req-cea8fcd1-4e3f-4cfb-8ee4-fee068d7d93a service nova] Creating event network-changed:fe87d5c2-e7cb-44a8-bcf1-7d5b938d8647 for instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c on hv-cinder-85031 Jul 21 06:36:23.471085 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-f4c8cec3-c176-4a19-ab3e-e4f7337009f9 req-cea8fcd1-4e3f-4cfb-8ee4-fee068d7d93a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030465 Jul 21 06:36:23.471673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 462/914] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:24.207339 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c48a950e-720a-4018-8990-030c265ddf10 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:24.207953 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c48a950e-720a-4018-8990-030c265ddf10 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:24.214576 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c48a950e-720a-4018-8990-030c265ddf10 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:24.215031 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c48a950e-720a-4018-8990-030c265ddf10 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:24.216367 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c48a950e-720a-4018-8990-030c265ddf10 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:24.216804 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c48a950e-720a-4018-8990-030c265ddf10 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:24.359829 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c48a950e-720a-4018-8990-030c265ddf10 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:24.367363 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c48a950e-720a-4018-8990-030c265ddf10 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1684 microversion: 2.1 time: 0.163905 Jul 21 06:36:24.367937 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 453/915] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:24 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:25.385678 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f77d6035-d785-4a07-ab0f-3cb0c77659d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:25.386421 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f77d6035-d785-4a07-ab0f-3cb0c77659d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:25.393242 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f77d6035-d785-4a07-ab0f-3cb0c77659d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:25.393698 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f77d6035-d785-4a07-ab0f-3cb0c77659d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:25.394499 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f77d6035-d785-4a07-ab0f-3cb0c77659d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:25.394947 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f77d6035-d785-4a07-ab0f-3cb0c77659d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:25.521021 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f77d6035-d785-4a07-ab0f-3cb0c77659d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:25.528902 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f77d6035-d785-4a07-ab0f-3cb0c77659d0 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1684 microversion: 2.1 time: 0.147912 Jul 21 06:36:25.529471 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 463/916] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:25 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:25.804165 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-58318911-6b79-4e36-b901-49cfce7ec5fd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:25.804670 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-58318911-6b79-4e36-b901-49cfce7ec5fd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:25.811778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-58318911-6b79-4e36-b901-49cfce7ec5fd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:25.812232 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-58318911-6b79-4e36-b901-49cfce7ec5fd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:25.813010 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-58318911-6b79-4e36-b901-49cfce7ec5fd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:25.813454 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-58318911-6b79-4e36-b901-49cfce7ec5fd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:25.836908 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-58318911-6b79-4e36-b901-49cfce7ec5fd tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/ips" status: 200 len: 152 microversion: 2.20 time: 0.036714 Jul 21 06:36:25.837488 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 454/917] 10.222.0.42 () {60 vars in 1288 bytes} [Thu Jul 21 06:36:25 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 06:36:26.545061 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9612075b-4700-4cf2-8b32-1b3170366ecc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:26.545673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9612075b-4700-4cf2-8b32-1b3170366ecc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:26.552254 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9612075b-4700-4cf2-8b32-1b3170366ecc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:26.552704 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9612075b-4700-4cf2-8b32-1b3170366ecc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:26.553469 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9612075b-4700-4cf2-8b32-1b3170366ecc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:26.553905 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9612075b-4700-4cf2-8b32-1b3170366ecc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:26.689495 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9612075b-4700-4cf2-8b32-1b3170366ecc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:26.697161 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9612075b-4700-4cf2-8b32-1b3170366ecc tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1684 microversion: 2.1 time: 0.155961 Jul 21 06:36:26.697926 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 464/918] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:26 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:27.715157 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d0d40158-763c-455a-a8bb-480a821acec2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:27.715779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d0d40158-763c-455a-a8bb-480a821acec2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:27.718341 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:27.723653 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d0d40158-763c-455a-a8bb-480a821acec2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:27.724102 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d0d40158-763c-455a-a8bb-480a821acec2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:27.724881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d0d40158-763c-455a-a8bb-480a821acec2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:27.725323 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d0d40158-763c-455a-a8bb-480a821acec2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:27.880127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d0d40158-763c-455a-a8bb-480a821acec2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:27.890243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d0d40158-763c-455a-a8bb-480a821acec2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1684 microversion: 2.1 time: 0.178911 Jul 21 06:36:27.891433 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 455/919] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:27 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:36:28.082327 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-34ae65d5-cc8a-486e-8bb8-1b484d836a77 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:28.082920 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-34ae65d5-cc8a-486e-8bb8-1b484d836a77 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:28.089721 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-34ae65d5-cc8a-486e-8bb8-1b484d836a77 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:28.090782 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-34ae65d5-cc8a-486e-8bb8-1b484d836a77 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:28.091633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-34ae65d5-cc8a-486e-8bb8-1b484d836a77 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:28.092090 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-34ae65d5-cc8a-486e-8bb8-1b484d836a77 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:28.134125 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-34ae65d5-cc8a-486e-8bb8-1b484d836a77 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lazy-loading 'flavor' on Instance uuid d6ff60b2-b16b-481d-8396-016f9068bff1 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:36:28.163958 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-471bbced-4824-4608-a63f-c381d095996d req-6a412874-8c2d-4b0c-b886-c0af2410ad25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd58c058-dd88-4697-8b77-c6e64e146c12", "name": "network-vif-deleted", "tag": "bc14977c-2f5f-4905-b7e5-abf33c78ca67"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:28.187743 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-471bbced-4824-4608-a63f-c381d095996d req-6a412874-8c2d-4b0c-b886-c0af2410ad25 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:28.190970 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-471bbced-4824-4608-a63f-c381d095996d req-6a412874-8c2d-4b0c-b886-c0af2410ad25 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:28.214940 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-471bbced-4824-4608-a63f-c381d095996d req-6a412874-8c2d-4b0c-b886-c0af2410ad25 service nova] Creating event network-vif-deleted:bc14977c-2f5f-4905-b7e5-abf33c78ca67 for instance dd58c058-dd88-4697-8b77-c6e64e146c12 on hv-cinder-85031 Jul 21 06:36:28.221129 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-471bbced-4824-4608-a63f-c381d095996d req-6a412874-8c2d-4b0c-b886-c0af2410ad25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061897 Jul 21 06:36:28.231537 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 456/920] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:28.507968 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-34ae65d5-cc8a-486e-8bb8-1b484d836a77 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "POST /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/action" status: 202 len: 0 microversion: 2.20 time: 0.429477 Jul 21 06:36:28.512642 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 465/921] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jul 21 06:36:28 2022] POST /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:36:28.517926 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-11fb1306-e2ae-420b-b20a-f2f96bd7102f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:28.518661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-11fb1306-e2ae-420b-b20a-f2f96bd7102f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:28.525429 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-11fb1306-e2ae-420b-b20a-f2f96bd7102f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:28.526242 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-11fb1306-e2ae-420b-b20a-f2f96bd7102f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:28.526996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-11fb1306-e2ae-420b-b20a-f2f96bd7102f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:28.527632 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-11fb1306-e2ae-420b-b20a-f2f96bd7102f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:28.663450 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-11fb1306-e2ae-420b-b20a-f2f96bd7102f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:28.675288 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-11fb1306-e2ae-420b-b20a-f2f96bd7102f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:28.677102 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-11fb1306-e2ae-420b-b20a-f2f96bd7102f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:28.678377 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-11fb1306-e2ae-420b-b20a-f2f96bd7102f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.164715 Jul 21 06:36:28.678951 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 457/922] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:28 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:28.912457 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:28.913306 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:28.921153 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:28.921788 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:28.922928 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:28.924304 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:28.961629 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:28.963012 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:28.963012 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lazy-loading 'fault' on Instance uuid dd58c058-dd88-4697-8b77-c6e64e146c12 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:36:29.009500 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:29.016925 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-925410e2-f861-4621-8c09-d065b9a12682 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 200 len: 1332 microversion: 2.1 time: 0.109695 Jul 21 06:36:29.017523 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 466/923] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:28 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:29.698293 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f394cbec-5446-41e4-a79a-8ca40a4693f0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:29.698838 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f394cbec-5446-41e4-a79a-8ca40a4693f0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:29.705814 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f394cbec-5446-41e4-a79a-8ca40a4693f0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:29.706302 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f394cbec-5446-41e4-a79a-8ca40a4693f0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:29.707077 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f394cbec-5446-41e4-a79a-8ca40a4693f0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:29.707514 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f394cbec-5446-41e4-a79a-8ca40a4693f0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:29.840246 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f394cbec-5446-41e4-a79a-8ca40a4693f0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:29.848317 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f394cbec-5446-41e4-a79a-8ca40a4693f0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:29.850007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f394cbec-5446-41e4-a79a-8ca40a4693f0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:29.851478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f394cbec-5446-41e4-a79a-8ca40a4693f0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.157139 Jul 21 06:36:29.852204 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 458/924] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:29 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:30.034562 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a35ff340-8f85-4ed0-98f8-5dabd3edb6a7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:30.035217 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a35ff340-8f85-4ed0-98f8-5dabd3edb6a7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:30.041761 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a35ff340-8f85-4ed0-98f8-5dabd3edb6a7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:30.042379 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a35ff340-8f85-4ed0-98f8-5dabd3edb6a7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:30.043185 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a35ff340-8f85-4ed0-98f8-5dabd3edb6a7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:30.043628 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a35ff340-8f85-4ed0-98f8-5dabd3edb6a7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:30.059039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-a35ff340-8f85-4ed0-98f8-5dabd3edb6a7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a35ff340-8f85-4ed0-98f8-5dabd3edb6a7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 HTTP/1.1 Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:36:30.061201 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:36:30.062592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'dd58c058-dd88-4697-8b77-c6e64e146c12'} Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:36:30.063337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:36:30.064655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:36:30.066016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a35ff340-8f85-4ed0-98f8-5dabd3edb6a7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:36:30.066016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a35ff340-8f85-4ed0-98f8-5dabd3edb6a7 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 404 len: 111 microversion: 2.1 time: 0.032004 Jul 21 06:36:30.066016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 467/925] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:30 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:36:30.071553 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-aed50d94-3183-438d-88b0-aaf098c1aa5e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '.version_select at 0x7f9327b7cf70>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:30.088876 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-aed50d94-3183-438d-88b0-aaf098c1aa5e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491834606" status: 202 len: 0 microversion: 2.1 time: 0.021084 Jul 21 06:36:30.089432 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 459/926] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jul 21 06:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491834606 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:36:30.698214 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bd04bf23-1d5e-493b-91ac-55fd21bd0496 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: .version_select at 0x7f9327a15790>, body: {"keypair": {"name": "tempest-keypair-865693186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADPu6JMNs34Zxhq8GUeHOYFEf0tHfxMeHF18kYdSzh8MRQU6unZm5y4M3m6JydEUOBNqRM3oGQ68+Eqdt5DYZrBZ/IfG/dypKlEKxcxJZOk4PghrZLx95Q0u1dWPBQ40A=="}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:30.702439 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:30.714380 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-bd04bf23-1d5e-493b-91ac-55fd21bd0496 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:36:30.719432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-bd04bf23-1d5e-493b-91ac-55fd21bd0496 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for user 5c54ac39faa84c7db5b9b63360216d7b and project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:36:30.742900 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bd04bf23-1d5e-493b-91ac-55fd21bd0496 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048591 Jul 21 06:36:30.743964 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 468/927] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 06:36:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:36:30.870152 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-115f2799-83c3-4b66-80f1-30d105f13329 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:30.871324 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-115f2799-83c3-4b66-80f1-30d105f13329 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:30.879248 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-115f2799-83c3-4b66-80f1-30d105f13329 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:30.880259 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-115f2799-83c3-4b66-80f1-30d105f13329 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:30.881251 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-115f2799-83c3-4b66-80f1-30d105f13329 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:30.881785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-115f2799-83c3-4b66-80f1-30d105f13329 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:31.087560 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-115f2799-83c3-4b66-80f1-30d105f13329 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:31.102785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-115f2799-83c3-4b66-80f1-30d105f13329 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:31.104827 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-115f2799-83c3-4b66-80f1-30d105f13329 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:31.110643 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-115f2799-83c3-4b66-80f1-30d105f13329 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.244899 Jul 21 06:36:31.111464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 460/928] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:30 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:32.130103 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c833eeab-603d-4ae5-a5b9-bde1bc1f7ca0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:32.131276 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c833eeab-603d-4ae5-a5b9-bde1bc1f7ca0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:32.146046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c833eeab-603d-4ae5-a5b9-bde1bc1f7ca0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:32.146794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c833eeab-603d-4ae5-a5b9-bde1bc1f7ca0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:32.148023 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c833eeab-603d-4ae5-a5b9-bde1bc1f7ca0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:32.148735 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c833eeab-603d-4ae5-a5b9-bde1bc1f7ca0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:32.242404 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1890831539", "imageRef": "ca849c59-44f5-4b35-8e9f-02e9ce8f8c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fac3a692-b3e2-4555-a0ad-f0227031fd7d"}], "security_groups": [{"name": "tempest-securitygroup--1308903952"}], "key_name": "tempest-keypair-865693186", "user_data": "}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:32.306759 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c833eeab-603d-4ae5-a5b9-bde1bc1f7ca0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:32.322352 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c833eeab-603d-4ae5-a5b9-bde1bc1f7ca0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:32.323976 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c833eeab-603d-4ae5-a5b9-bde1bc1f7ca0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:32.325673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c833eeab-603d-4ae5-a5b9-bde1bc1f7ca0 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.200581 Jul 21 06:36:32.326347 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 469/929] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:32 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:32.349476 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.network.neutron [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] validate_networks() for [('fac3a692-b3e2-4555-a0ad-f0227031fd7d', None, None, None, None, None)] {{(pid=117905) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:36:32.815878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Flavor limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:36:32.816313 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Image limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:36:32.816796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Flavor pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:36:32.817243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Image pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:36:32.817662 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:36:32.827242 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:32.827692 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:32.828500 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:32.828938 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:32.846021 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:36:32.850649 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Getting quotas for user 5c54ac39faa84c7db5b9b63360216d7b and project f1b4bcbfdd4a42e5a542dbf019166beb. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:36:32.862255 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Going to run 1 instances... {{(pid=117905) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:36:32.864584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca849c59-44f5-4b35-8e9f-02e9ce8f8c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:36:32.916490 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-edcacd2c-d527-4fe9-b1d5-ca825054be99 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678320 Jul 21 06:36:32.917143 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 461/930] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:36:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 06:36:32.927123 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6708cf6b-777b-4f0e-b19c-9b287d21fbb8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:32.928517 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6708cf6b-777b-4f0e-b19c-9b287d21fbb8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:32.987773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6708cf6b-777b-4f0e-b19c-9b287d21fbb8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:32.994728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6708cf6b-777b-4f0e-b19c-9b287d21fbb8 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1241 microversion: 2.1 time: 0.071367 Jul 21 06:36:32.995405 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 470/931] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:32 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:33.344851 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-24625bd1-68e2-426b-a5ea-31d820be6465 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:33.345472 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-24625bd1-68e2-426b-a5ea-31d820be6465 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:33.352414 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-24625bd1-68e2-426b-a5ea-31d820be6465 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:33.352871 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-24625bd1-68e2-426b-a5ea-31d820be6465 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:33.353654 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-24625bd1-68e2-426b-a5ea-31d820be6465 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:33.354129 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-24625bd1-68e2-426b-a5ea-31d820be6465 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:33.490992 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-24625bd1-68e2-426b-a5ea-31d820be6465 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:33.499846 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-24625bd1-68e2-426b-a5ea-31d820be6465 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:33.501392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-24625bd1-68e2-426b-a5ea-31d820be6465 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:33.502624 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-24625bd1-68e2-426b-a5ea-31d820be6465 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.163197 Jul 21 06:36:33.503191 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 462/932] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:33 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:34.013155 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c9de4b54-60dd-4fb6-8f85-a3cbafe9c2ef tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:34.014014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c9de4b54-60dd-4fb6-8f85-a3cbafe9c2ef tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:34.021244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9de4b54-60dd-4fb6-8f85-a3cbafe9c2ef tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:34.021710 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9de4b54-60dd-4fb6-8f85-a3cbafe9c2ef tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:34.022522 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9de4b54-60dd-4fb6-8f85-a3cbafe9c2ef tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:34.022964 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c9de4b54-60dd-4fb6-8f85-a3cbafe9c2ef tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:34.090360 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c9de4b54-60dd-4fb6-8f85-a3cbafe9c2ef tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:34.100531 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c9de4b54-60dd-4fb6-8f85-a3cbafe9c2ef tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1301 microversion: 2.1 time: 0.091867 Jul 21 06:36:34.101115 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 471/933] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:34 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:34.520977 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-be635489-29bd-4e8f-b8e7-8fe8e4c54dd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:34.521622 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-be635489-29bd-4e8f-b8e7-8fe8e4c54dd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:34.528892 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-be635489-29bd-4e8f-b8e7-8fe8e4c54dd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:34.529434 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-be635489-29bd-4e8f-b8e7-8fe8e4c54dd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:34.530423 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-be635489-29bd-4e8f-b8e7-8fe8e4c54dd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:34.530863 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-be635489-29bd-4e8f-b8e7-8fe8e4c54dd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:34.535222 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:34.665476 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-be635489-29bd-4e8f-b8e7-8fe8e4c54dd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:34.674273 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-be635489-29bd-4e8f-b8e7-8fe8e4c54dd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:34.675824 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-be635489-29bd-4e8f-b8e7-8fe8e4c54dd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:34.677006 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-be635489-29bd-4e8f-b8e7-8fe8e4c54dd8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.160234 Jul 21 06:36:34.677605 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 463/934] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:34 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:35.118633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b2b901ab-39d5-4bc1-b5dd-4d250237ba97 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:35.119433 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b2b901ab-39d5-4bc1-b5dd-4d250237ba97 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:35.126561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2b901ab-39d5-4bc1-b5dd-4d250237ba97 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:35.127018 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2b901ab-39d5-4bc1-b5dd-4d250237ba97 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:35.127808 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2b901ab-39d5-4bc1-b5dd-4d250237ba97 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:35.128250 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2b901ab-39d5-4bc1-b5dd-4d250237ba97 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:35.147722 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:35.269806 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-b2b901ab-39d5-4bc1-b5dd-4d250237ba97 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:35.277615 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b2b901ab-39d5-4bc1-b5dd-4d250237ba97 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1367 microversion: 2.1 time: 0.162834 Jul 21 06:36:35.279056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 472/935] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:35 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:35.696076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d9eccd66-5f3b-419c-97f6-9c6328c537ad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:35.696589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d9eccd66-5f3b-419c-97f6-9c6328c537ad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:35.703180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d9eccd66-5f3b-419c-97f6-9c6328c537ad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:35.703628 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d9eccd66-5f3b-419c-97f6-9c6328c537ad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:35.704384 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d9eccd66-5f3b-419c-97f6-9c6328c537ad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:35.704817 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d9eccd66-5f3b-419c-97f6-9c6328c537ad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:35.830117 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d9eccd66-5f3b-419c-97f6-9c6328c537ad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:35.837963 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d9eccd66-5f3b-419c-97f6-9c6328c537ad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:35.839462 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d9eccd66-5f3b-419c-97f6-9c6328c537ad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:35.840668 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d9eccd66-5f3b-419c-97f6-9c6328c537ad tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.148561 Jul 21 06:36:35.841219 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 464/936] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:35 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:36.296723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7f9fdfd6-a1b0-4b2d-87da-273ff51230a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:36.297314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7f9fdfd6-a1b0-4b2d-87da-273ff51230a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:36.303832 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f9fdfd6-a1b0-4b2d-87da-273ff51230a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:36.304280 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f9fdfd6-a1b0-4b2d-87da-273ff51230a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:36.305031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f9fdfd6-a1b0-4b2d-87da-273ff51230a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:36.305460 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7f9fdfd6-a1b0-4b2d-87da-273ff51230a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:36.434126 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7f9fdfd6-a1b0-4b2d-87da-273ff51230a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:36.442423 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7f9fdfd6-a1b0-4b2d-87da-273ff51230a1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1367 microversion: 2.1 time: 0.150534 Jul 21 06:36:36.442982 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 473/937] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:36 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:36.859889 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4d9815cc-5fd6-48f3-a4e4-be3d839df182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:36.860606 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4d9815cc-5fd6-48f3-a4e4-be3d839df182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:36.867151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d9815cc-5fd6-48f3-a4e4-be3d839df182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:36.867598 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d9815cc-5fd6-48f3-a4e4-be3d839df182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:36.868363 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d9815cc-5fd6-48f3-a4e4-be3d839df182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:36.868800 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4d9815cc-5fd6-48f3-a4e4-be3d839df182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:37.235675 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4d9815cc-5fd6-48f3-a4e4-be3d839df182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:37.243661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4d9815cc-5fd6-48f3-a4e4-be3d839df182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:37.245194 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4d9815cc-5fd6-48f3-a4e4-be3d839df182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:37.246400 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4d9815cc-5fd6-48f3-a4e4-be3d839df182 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.391388 Jul 21 06:36:37.247038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 465/938] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:36 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:37.459230 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-62f6f5c8-2682-4f0b-8b69-1e8820823286 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:37.459847 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-62f6f5c8-2682-4f0b-8b69-1e8820823286 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:37.480230 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-62f6f5c8-2682-4f0b-8b69-1e8820823286 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:37.482632 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-62f6f5c8-2682-4f0b-8b69-1e8820823286 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:37.483445 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-62f6f5c8-2682-4f0b-8b69-1e8820823286 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:37.483875 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-62f6f5c8-2682-4f0b-8b69-1e8820823286 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:37.655676 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-62f6f5c8-2682-4f0b-8b69-1e8820823286 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:37.665072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-62f6f5c8-2682-4f0b-8b69-1e8820823286 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1367 microversion: 2.1 time: 0.209607 Jul 21 06:36:37.666120 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 474/939] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:37 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:37.919874 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-8621254d-4561-479d-b605-adcc496c448d req-93c8431d-3993-4a1b-809f-cd9f51f208de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d03e98-dac8-461e-8cbe-8ae960c87228", "tag": "612a5fc7-7a9f-44fe-9ef7-1df871aa95f6"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:37.930981 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-8621254d-4561-479d-b605-adcc496c448d req-93c8431d-3993-4a1b-809f-cd9f51f208de service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:37.931502 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-8621254d-4561-479d-b605-adcc496c448d req-93c8431d-3993-4a1b-809f-cd9f51f208de service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:37.947676 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-8621254d-4561-479d-b605-adcc496c448d req-93c8431d-3993-4a1b-809f-cd9f51f208de service nova] Creating event network-changed:612a5fc7-7a9f-44fe-9ef7-1df871aa95f6 for instance 06d03e98-dac8-461e-8cbe-8ae960c87228 on hv-cinder-85031 Jul 21 06:36:37.955153 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-8621254d-4561-479d-b605-adcc496c448d req-93c8431d-3993-4a1b-809f-cd9f51f208de service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040504 Jul 21 06:36:37.956011 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 466/940] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:36:38.266013 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9a21df2f-3b61-483b-b9ab-5a6b4c6964f1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:38.266984 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9a21df2f-3b61-483b-b9ab-5a6b4c6964f1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:38.276020 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9a21df2f-3b61-483b-b9ab-5a6b4c6964f1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:38.276585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9a21df2f-3b61-483b-b9ab-5a6b4c6964f1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:38.277369 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9a21df2f-3b61-483b-b9ab-5a6b4c6964f1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:38.277811 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9a21df2f-3b61-483b-b9ab-5a6b4c6964f1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:38.418706 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9a21df2f-3b61-483b-b9ab-5a6b4c6964f1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:38.426630 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9a21df2f-3b61-483b-b9ab-5a6b4c6964f1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:38.428117 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-9a21df2f-3b61-483b-b9ab-5a6b4c6964f1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:38.429283 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9a21df2f-3b61-483b-b9ab-5a6b4c6964f1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.168679 Jul 21 06:36:38.429841 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 475/941] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:38 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:38.683026 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b4348bd4-52dc-4605-9cd1-86883ffa8616 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:38.683737 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b4348bd4-52dc-4605-9cd1-86883ffa8616 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:38.690612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b4348bd4-52dc-4605-9cd1-86883ffa8616 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:38.691066 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b4348bd4-52dc-4605-9cd1-86883ffa8616 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:38.691829 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b4348bd4-52dc-4605-9cd1-86883ffa8616 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:38.692266 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b4348bd4-52dc-4605-9cd1-86883ffa8616 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:38.820066 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b4348bd4-52dc-4605-9cd1-86883ffa8616 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:38.827647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b4348bd4-52dc-4605-9cd1-86883ffa8616 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1367 microversion: 2.1 time: 0.148873 Jul 21 06:36:38.828201 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 467/942] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:38 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:39.447765 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e0cf2bfe-850f-462d-95f9-9aaa472777b2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:39.448370 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e0cf2bfe-850f-462d-95f9-9aaa472777b2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:39.455457 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e0cf2bfe-850f-462d-95f9-9aaa472777b2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:39.455905 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e0cf2bfe-850f-462d-95f9-9aaa472777b2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:39.456664 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e0cf2bfe-850f-462d-95f9-9aaa472777b2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:39.457098 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e0cf2bfe-850f-462d-95f9-9aaa472777b2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:39.589247 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e0cf2bfe-850f-462d-95f9-9aaa472777b2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:39.597829 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e0cf2bfe-850f-462d-95f9-9aaa472777b2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:39.599382 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e0cf2bfe-850f-462d-95f9-9aaa472777b2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:39.600555 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e0cf2bfe-850f-462d-95f9-9aaa472777b2 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.156742 Jul 21 06:36:39.601119 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 476/943] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:39 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:39.845494 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b751a5be-2658-49f5-a318-1e5e6befd7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:39.846075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b751a5be-2658-49f5-a318-1e5e6befd7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:39.852154 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b751a5be-2658-49f5-a318-1e5e6befd7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:39.852637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b751a5be-2658-49f5-a318-1e5e6befd7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:39.853409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b751a5be-2658-49f5-a318-1e5e6befd7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:39.853851 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b751a5be-2658-49f5-a318-1e5e6befd7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:39.982449 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b751a5be-2658-49f5-a318-1e5e6befd7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:39.989886 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b751a5be-2658-49f5-a318-1e5e6befd7b5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1367 microversion: 2.1 time: 0.149410 Jul 21 06:36:39.990483 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 468/944] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:39 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:40.619622 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-00fd5422-9001-4e78-89d7-e10c1086c783 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:40.620232 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-00fd5422-9001-4e78-89d7-e10c1086c783 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:40.627570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-00fd5422-9001-4e78-89d7-e10c1086c783 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:40.628018 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-00fd5422-9001-4e78-89d7-e10c1086c783 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:40.628779 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-00fd5422-9001-4e78-89d7-e10c1086c783 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:40.629216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-00fd5422-9001-4e78-89d7-e10c1086c783 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:40.764507 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-00fd5422-9001-4e78-89d7-e10c1086c783 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:40.772588 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-00fd5422-9001-4e78-89d7-e10c1086c783 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:40.774146 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-00fd5422-9001-4e78-89d7-e10c1086c783 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:40.775584 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-00fd5422-9001-4e78-89d7-e10c1086c783 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.159856 Jul 21 06:36:40.776147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 477/945] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:40 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:41.007332 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-666afae4-2285-4e44-8eb2-005ca77785d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:41.008053 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-666afae4-2285-4e44-8eb2-005ca77785d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:41.014926 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-666afae4-2285-4e44-8eb2-005ca77785d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:41.015468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-666afae4-2285-4e44-8eb2-005ca77785d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:41.016317 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-666afae4-2285-4e44-8eb2-005ca77785d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:41.016824 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-666afae4-2285-4e44-8eb2-005ca77785d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:41.162847 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-666afae4-2285-4e44-8eb2-005ca77785d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:41.171267 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-666afae4-2285-4e44-8eb2-005ca77785d1 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1367 microversion: 2.1 time: 0.167852 Jul 21 06:36:41.172125 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 469/946] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:41 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:41.793652 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3f0d0e96-0094-4a1e-b5d4-a330ffdc61bc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:41.795067 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3f0d0e96-0094-4a1e-b5d4-a330ffdc61bc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:41.802678 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3f0d0e96-0094-4a1e-b5d4-a330ffdc61bc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:41.803132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3f0d0e96-0094-4a1e-b5d4-a330ffdc61bc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:41.804103 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3f0d0e96-0094-4a1e-b5d4-a330ffdc61bc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:41.804542 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3f0d0e96-0094-4a1e-b5d4-a330ffdc61bc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:41.940653 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3f0d0e96-0094-4a1e-b5d4-a330ffdc61bc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:41.949427 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3f0d0e96-0094-4a1e-b5d4-a330ffdc61bc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:41.951198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3f0d0e96-0094-4a1e-b5d4-a330ffdc61bc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:41.952389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3f0d0e96-0094-4a1e-b5d4-a330ffdc61bc tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.162675 Jul 21 06:36:41.953135 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 478/947] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:41 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:42.189128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-cbae964b-8ea1-445d-908b-8c600d5e388e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:42.189820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-cbae964b-8ea1-445d-908b-8c600d5e388e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:42.196482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cbae964b-8ea1-445d-908b-8c600d5e388e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:42.196934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cbae964b-8ea1-445d-908b-8c600d5e388e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:42.197691 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cbae964b-8ea1-445d-908b-8c600d5e388e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:42.198153 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cbae964b-8ea1-445d-908b-8c600d5e388e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:42.328711 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-cbae964b-8ea1-445d-908b-8c600d5e388e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:42.336015 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-cbae964b-8ea1-445d-908b-8c600d5e388e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1367 microversion: 2.1 time: 0.151577 Jul 21 06:36:42.336575 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 470/948] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:42 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:42.972295 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bf94b89a-001a-4262-a57e-1a55fa22384b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:42.972908 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bf94b89a-001a-4262-a57e-1a55fa22384b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:42.979171 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bf94b89a-001a-4262-a57e-1a55fa22384b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:42.979627 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bf94b89a-001a-4262-a57e-1a55fa22384b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:42.980389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bf94b89a-001a-4262-a57e-1a55fa22384b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:42.980825 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bf94b89a-001a-4262-a57e-1a55fa22384b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:42.995769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=6 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:43.114391 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bf94b89a-001a-4262-a57e-1a55fa22384b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:43.123063 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bf94b89a-001a-4262-a57e-1a55fa22384b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:43.124585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bf94b89a-001a-4262-a57e-1a55fa22384b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:43.125773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bf94b89a-001a-4262-a57e-1a55fa22384b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.157413 Jul 21 06:36:43.126373 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 479/949] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:42 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:43.354202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-976c8b4a-2baf-4b20-a177-edc3b0b96f34 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:43.357022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-976c8b4a-2baf-4b20-a177-edc3b0b96f34 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:43.359138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:43.359958 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=6 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:43.366305 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-976c8b4a-2baf-4b20-a177-edc3b0b96f34 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:43.366829 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-976c8b4a-2baf-4b20-a177-edc3b0b96f34 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:43.367710 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-976c8b4a-2baf-4b20-a177-edc3b0b96f34 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:43.368392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-976c8b4a-2baf-4b20-a177-edc3b0b96f34 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:43.376639 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-3d2b44ff-fc32-4079-b539-7c9bdf181bf9 req-b69de7a7-c85e-4ee2-b1ce-14a7e67a4e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d03e98-dac8-461e-8cbe-8ae960c87228", "name": "network-vif-plugged", "status": "completed", "tag": "612a5fc7-7a9f-44fe-9ef7-1df871aa95f6"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:43.386823 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-3d2b44ff-fc32-4079-b539-7c9bdf181bf9 req-b69de7a7-c85e-4ee2-b1ce-14a7e67a4e9e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:43.387273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-3d2b44ff-fc32-4079-b539-7c9bdf181bf9 req-b69de7a7-c85e-4ee2-b1ce-14a7e67a4e9e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:43.398556 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-3d2b44ff-fc32-4079-b539-7c9bdf181bf9 req-b69de7a7-c85e-4ee2-b1ce-14a7e67a4e9e service nova] Creating event network-vif-plugged:612a5fc7-7a9f-44fe-9ef7-1df871aa95f6 for instance 06d03e98-dac8-461e-8cbe-8ae960c87228 on hv-cinder-85031 Jul 21 06:36:43.408177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-3d2b44ff-fc32-4079-b539-7c9bdf181bf9 req-b69de7a7-c85e-4ee2-b1ce-14a7e67a4e9e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035888 Jul 21 06:36:43.408177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 480/950] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:36:43.527688 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-976c8b4a-2baf-4b20-a177-edc3b0b96f34 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:43.537038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-976c8b4a-2baf-4b20-a177-edc3b0b96f34 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1367 microversion: 2.1 time: 0.187376 Jul 21 06:36:43.537827 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 471/951] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:43 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:44.146071 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-191f5f7f-2c81-4d78-9e8f-4ef8fc98d4af tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:44.146754 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-191f5f7f-2c81-4d78-9e8f-4ef8fc98d4af tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:44.153577 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-191f5f7f-2c81-4d78-9e8f-4ef8fc98d4af tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:44.154232 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-191f5f7f-2c81-4d78-9e8f-4ef8fc98d4af tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:44.155013 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-191f5f7f-2c81-4d78-9e8f-4ef8fc98d4af tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:44.155450 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-191f5f7f-2c81-4d78-9e8f-4ef8fc98d4af tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:44.284307 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-191f5f7f-2c81-4d78-9e8f-4ef8fc98d4af tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:44.293207 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-191f5f7f-2c81-4d78-9e8f-4ef8fc98d4af tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:44.295853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-191f5f7f-2c81-4d78-9e8f-4ef8fc98d4af tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:44.297040 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-191f5f7f-2c81-4d78-9e8f-4ef8fc98d4af tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.156069 Jul 21 06:36:44.297602 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 481/952] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:44 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:44.554865 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3a3723eb-8d42-41f5-909a-e60619e0b50a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:44.555479 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3a3723eb-8d42-41f5-909a-e60619e0b50a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:44.562745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3a3723eb-8d42-41f5-909a-e60619e0b50a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:44.563650 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3a3723eb-8d42-41f5-909a-e60619e0b50a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:44.564014 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3a3723eb-8d42-41f5-909a-e60619e0b50a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:44.564566 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3a3723eb-8d42-41f5-909a-e60619e0b50a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:44.695450 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3a3723eb-8d42-41f5-909a-e60619e0b50a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:44.703402 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3a3723eb-8d42-41f5-909a-e60619e0b50a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1367 microversion: 2.1 time: 0.152436 Jul 21 06:36:44.703983 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 472/953] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:44 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:45.315266 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f935dcec-a97f-41cf-a5a0-160ec008b02d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:45.315888 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f935dcec-a97f-41cf-a5a0-160ec008b02d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:45.322312 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f935dcec-a97f-41cf-a5a0-160ec008b02d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:45.322767 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f935dcec-a97f-41cf-a5a0-160ec008b02d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:45.323535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f935dcec-a97f-41cf-a5a0-160ec008b02d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:45.323975 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f935dcec-a97f-41cf-a5a0-160ec008b02d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:45.482955 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f935dcec-a97f-41cf-a5a0-160ec008b02d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:45.491143 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f935dcec-a97f-41cf-a5a0-160ec008b02d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:45.492643 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f935dcec-a97f-41cf-a5a0-160ec008b02d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:45.493810 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f935dcec-a97f-41cf-a5a0-160ec008b02d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.182469 Jul 21 06:36:45.494730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 482/954] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:45 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:36:45.720565 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-34e00cbd-7b4e-44d8-8156-578d7816a1f6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:45.721185 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-34e00cbd-7b4e-44d8-8156-578d7816a1f6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:45.727776 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-34e00cbd-7b4e-44d8-8156-578d7816a1f6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:45.728234 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-34e00cbd-7b4e-44d8-8156-578d7816a1f6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:45.729006 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-34e00cbd-7b4e-44d8-8156-578d7816a1f6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:45.729448 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-34e00cbd-7b4e-44d8-8156-578d7816a1f6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:45.864981 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-34e00cbd-7b4e-44d8-8156-578d7816a1f6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:45.874005 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-34e00cbd-7b4e-44d8-8156-578d7816a1f6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1558 microversion: 2.1 time: 0.157309 Jul 21 06:36:45.874660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 473/955] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:36:45 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:36:45.890647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c3c6e08e-c48b-4c0c-92df-0015a43f9037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:45.891290 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c3c6e08e-c48b-4c0c-92df-0015a43f9037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:45.897415 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c3c6e08e-c48b-4c0c-92df-0015a43f9037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:45.897872 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c3c6e08e-c48b-4c0c-92df-0015a43f9037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:45.898698 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c3c6e08e-c48b-4c0c-92df-0015a43f9037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:45.899141 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c3c6e08e-c48b-4c0c-92df-0015a43f9037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:45.979708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c3c6e08e-c48b-4c0c-92df-0015a43f9037 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093493 Jul 21 06:36:45.980448 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 483/956] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 06:36:45 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:46.513856 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-398468d4-41e7-4aff-b0ee-bea7fa1aea89 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:46.514633 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-398468d4-41e7-4aff-b0ee-bea7fa1aea89 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:46.521348 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-398468d4-41e7-4aff-b0ee-bea7fa1aea89 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:46.521888 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-398468d4-41e7-4aff-b0ee-bea7fa1aea89 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:46.522810 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-398468d4-41e7-4aff-b0ee-bea7fa1aea89 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:46.523301 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-398468d4-41e7-4aff-b0ee-bea7fa1aea89 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:46.754007 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-398468d4-41e7-4aff-b0ee-bea7fa1aea89 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:46.762341 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-398468d4-41e7-4aff-b0ee-bea7fa1aea89 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:46.764062 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-398468d4-41e7-4aff-b0ee-bea7fa1aea89 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:46.765447 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-398468d4-41e7-4aff-b0ee-bea7fa1aea89 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.256760 Jul 21 06:36:46.766253 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 474/957] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:46 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:47.031437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-82b363a4-8db0-4884-ad07-943750e84449 req-022ad419-4df5-4e3e-a64f-09d83480c951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d03e98-dac8-461e-8cbe-8ae960c87228", "tag": "612a5fc7-7a9f-44fe-9ef7-1df871aa95f6"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:47.039722 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-82b363a4-8db0-4884-ad07-943750e84449 req-022ad419-4df5-4e3e-a64f-09d83480c951 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:47.040177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-82b363a4-8db0-4884-ad07-943750e84449 req-022ad419-4df5-4e3e-a64f-09d83480c951 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:47.052177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-82b363a4-8db0-4884-ad07-943750e84449 req-022ad419-4df5-4e3e-a64f-09d83480c951 service nova] Creating event network-changed:612a5fc7-7a9f-44fe-9ef7-1df871aa95f6 for instance 06d03e98-dac8-461e-8cbe-8ae960c87228 on hv-cinder-85031 Jul 21 06:36:47.058066 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-82b363a4-8db0-4884-ad07-943750e84449 req-022ad419-4df5-4e3e-a64f-09d83480c951 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030638 Jul 21 06:36:47.058980 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 484/958] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:47.785427 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7bdb3aea-5639-4861-b6f3-b25b0562d798 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:47.787246 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7bdb3aea-5639-4861-b6f3-b25b0562d798 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:47.793023 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7bdb3aea-5639-4861-b6f3-b25b0562d798 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:47.793490 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7bdb3aea-5639-4861-b6f3-b25b0562d798 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:47.795100 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7bdb3aea-5639-4861-b6f3-b25b0562d798 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:47.795545 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7bdb3aea-5639-4861-b6f3-b25b0562d798 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:47.950405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7bdb3aea-5639-4861-b6f3-b25b0562d798 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:47.960222 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7bdb3aea-5639-4861-b6f3-b25b0562d798 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:47.961743 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7bdb3aea-5639-4861-b6f3-b25b0562d798 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:47.962996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7bdb3aea-5639-4861-b6f3-b25b0562d798 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.181957 Jul 21 06:36:47.963892 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 475/959] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:47 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:48.984361 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1917dc87-72d6-499a-9725-69ef8418eef3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:48.985787 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1917dc87-72d6-499a-9725-69ef8418eef3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:48.992709 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1917dc87-72d6-499a-9725-69ef8418eef3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:48.993449 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1917dc87-72d6-499a-9725-69ef8418eef3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:48.994423 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1917dc87-72d6-499a-9725-69ef8418eef3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:48.995017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1917dc87-72d6-499a-9725-69ef8418eef3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:49.180925 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1917dc87-72d6-499a-9725-69ef8418eef3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:49.195975 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1917dc87-72d6-499a-9725-69ef8418eef3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:49.198272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1917dc87-72d6-499a-9725-69ef8418eef3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:49.200945 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1917dc87-72d6-499a-9725-69ef8418eef3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.221455 Jul 21 06:36:49.202036 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 485/960] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:48 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:36:50.220849 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-53a969a8-bced-4cb2-9892-2390bf103f91 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:50.221527 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-53a969a8-bced-4cb2-9892-2390bf103f91 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:50.228185 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-53a969a8-bced-4cb2-9892-2390bf103f91 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:50.228752 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-53a969a8-bced-4cb2-9892-2390bf103f91 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:50.229627 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-53a969a8-bced-4cb2-9892-2390bf103f91 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:50.230190 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-53a969a8-bced-4cb2-9892-2390bf103f91 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:50.383401 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-53a969a8-bced-4cb2-9892-2390bf103f91 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:50.395147 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-53a969a8-bced-4cb2-9892-2390bf103f91 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:50.397745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-53a969a8-bced-4cb2-9892-2390bf103f91 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:50.399588 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-53a969a8-bced-4cb2-9892-2390bf103f91 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1745 microversion: 2.20 time: 0.183042 Jul 21 06:36:50.401531 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 476/961] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:50 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:51.420382 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-951d5580-2a02-4326-80e2-250cf55db6e3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:51.421600 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-951d5580-2a02-4326-80e2-250cf55db6e3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:51.428801 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-951d5580-2a02-4326-80e2-250cf55db6e3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:51.429619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-951d5580-2a02-4326-80e2-250cf55db6e3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:51.430673 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-951d5580-2a02-4326-80e2-250cf55db6e3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:51.431472 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-951d5580-2a02-4326-80e2-250cf55db6e3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:51.682913 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-951d5580-2a02-4326-80e2-250cf55db6e3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:51.692226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-951d5580-2a02-4326-80e2-250cf55db6e3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:51.693717 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-951d5580-2a02-4326-80e2-250cf55db6e3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:51.694931 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-951d5580-2a02-4326-80e2-250cf55db6e3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1745 microversion: 2.20 time: 0.279188 Jul 21 06:36:51.695495 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 486/962] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:51 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1745 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:52.713052 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c0e4743a-8004-4354-8621-1927f326510e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:52.713667 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c0e4743a-8004-4354-8621-1927f326510e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:52.727286 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c0e4743a-8004-4354-8621-1927f326510e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:52.727796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c0e4743a-8004-4354-8621-1927f326510e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:52.728614 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c0e4743a-8004-4354-8621-1927f326510e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:52.729063 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c0e4743a-8004-4354-8621-1927f326510e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:53.098995 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c0e4743a-8004-4354-8621-1927f326510e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:53.108185 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c0e4743a-8004-4354-8621-1927f326510e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:53.109713 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c0e4743a-8004-4354-8621-1927f326510e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:53.124695 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c0e4743a-8004-4354-8621-1927f326510e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.415733 Jul 21 06:36:53.128535 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 477/963] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:52 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:53.749609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-caaeced0-6a1c-4eb5-9840-dda669234717 req-c14aff98-1eba-432a-bf96-ff8df0d8d1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ff60b2-b16b-481d-8396-016f9068bff1", "name": "network-vif-plugged", "status": "completed", "tag": "4aee29c5-9551-4f05-a973-a575a8c0fa54"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:53.769780 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-caaeced0-6a1c-4eb5-9840-dda669234717 req-c14aff98-1eba-432a-bf96-ff8df0d8d1ee service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:53.772791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-caaeced0-6a1c-4eb5-9840-dda669234717 req-c14aff98-1eba-432a-bf96-ff8df0d8d1ee service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:53.819240 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-caaeced0-6a1c-4eb5-9840-dda669234717 req-c14aff98-1eba-432a-bf96-ff8df0d8d1ee service nova] Creating event network-vif-plugged:4aee29c5-9551-4f05-a973-a575a8c0fa54 for instance d6ff60b2-b16b-481d-8396-016f9068bff1 on hv-cinder-85031 Jul 21 06:36:53.837808 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-caaeced0-6a1c-4eb5-9840-dda669234717 req-c14aff98-1eba-432a-bf96-ff8df0d8d1ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094359 Jul 21 06:36:53.839961 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 487/964] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:54.151418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e409d372-4466-4480-adb9-47ba38436296 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:54.152052 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e409d372-4466-4480-adb9-47ba38436296 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:54.168380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e409d372-4466-4480-adb9-47ba38436296 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:54.170709 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e409d372-4466-4480-adb9-47ba38436296 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:54.171776 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e409d372-4466-4480-adb9-47ba38436296 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:54.172395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e409d372-4466-4480-adb9-47ba38436296 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:54.514541 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e409d372-4466-4480-adb9-47ba38436296 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:54.529964 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e409d372-4466-4480-adb9-47ba38436296 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:54.531881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e409d372-4466-4480-adb9-47ba38436296 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:54.533434 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e409d372-4466-4480-adb9-47ba38436296 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.386031 Jul 21 06:36:54.546028 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 478/965] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:54 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:55.557639 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dd89d9bd-7f7a-4348-9cc3-6479c11e2e83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:55.563381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dd89d9bd-7f7a-4348-9cc3-6479c11e2e83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:55.571178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd89d9bd-7f7a-4348-9cc3-6479c11e2e83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:55.572022 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd89d9bd-7f7a-4348-9cc3-6479c11e2e83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:55.572953 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd89d9bd-7f7a-4348-9cc3-6479c11e2e83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:55.573548 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dd89d9bd-7f7a-4348-9cc3-6479c11e2e83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:55.838652 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dd89d9bd-7f7a-4348-9cc3-6479c11e2e83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:55.857840 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dd89d9bd-7f7a-4348-9cc3-6479c11e2e83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:55.862799 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dd89d9bd-7f7a-4348-9cc3-6479c11e2e83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:55.870100 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dd89d9bd-7f7a-4348-9cc3-6479c11e2e83 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.318661 Jul 21 06:36:55.885711 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 488/966] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:55 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:56.896111 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-bdce7379-7e73-4041-a066-c065d925fd7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:56.897037 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-bdce7379-7e73-4041-a066-c065d925fd7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:56.909038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdce7379-7e73-4041-a066-c065d925fd7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:56.911341 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdce7379-7e73-4041-a066-c065d925fd7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:56.913337 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdce7379-7e73-4041-a066-c065d925fd7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:56.914062 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdce7379-7e73-4041-a066-c065d925fd7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:57.151320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bdce7379-7e73-4041-a066-c065d925fd7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:57.160530 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bdce7379-7e73-4041-a066-c065d925fd7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:57.172994 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bdce7379-7e73-4041-a066-c065d925fd7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:57.174224 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-bdce7379-7e73-4041-a066-c065d925fd7b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.283025 Jul 21 06:36:57.174809 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 479/967] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:56 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:57.942576 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5d7761ca-b6b0-48a3-bed4-e6f0a00f5caf tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Action: 'create', calling method: .version_select at 0x7f9327ac21f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1626767190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1403Dx+L3kXCZVkSG54/34S1DPFT8Kv0unj4PcSu85w0qJfadlnoVkAkfHfhPce5R2Whe7xQ46mhfsZKlcq5ALo4HdPQXUtGRoSl4CW14e+gClpL0Zchebj+SvTlRfxg=="}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:57.957966 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-5d7761ca-b6b0-48a3-bed4-e6f0a00f5caf tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Getting quotas for project fd3a6e00103d49038260d28a680a9c56. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:36:57.965494 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-5d7761ca-b6b0-48a3-bed4-e6f0a00f5caf tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Getting quotas for user 0f951e37e60145aba97bcd1ff8aad260 and project fd3a6e00103d49038260d28a680a9c56. Resources: {'key_pairs'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:36:58.002532 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5d7761ca-b6b0-48a3-bed4-e6f0a00f5caf tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.407240 Jul 21 06:36:58.003806 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 489/968] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 06:36:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:36:58.174661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-359ea89f-5e65-4ac8-a456-5f147ff3d28a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:58.176202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-359ea89f-5e65-4ac8-a456-5f147ff3d28a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:58.192192 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:58.194068 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0db9a55a-d813-45ba-9a08-f818748d0b90 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:58.194956 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0db9a55a-d813-45ba-9a08-f818748d0b90 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:58.196903 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-359ea89f-5e65-4ac8-a456-5f147ff3d28a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:58.198296 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-359ea89f-5e65-4ac8-a456-5f147ff3d28a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:58.202536 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-359ea89f-5e65-4ac8-a456-5f147ff3d28a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:58.202536 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-359ea89f-5e65-4ac8-a456-5f147ff3d28a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:58.214025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0db9a55a-d813-45ba-9a08-f818748d0b90 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:58.214492 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0db9a55a-d813-45ba-9a08-f818748d0b90 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:58.215291 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0db9a55a-d813-45ba-9a08-f818748d0b90 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:58.215826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0db9a55a-d813-45ba-9a08-f818748d0b90 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:58.263269 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=100 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:36:58.268706 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-359ea89f-5e65-4ac8-a456-5f147ff3d28a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/ips" status: 200 len: 145 microversion: 2.1 time: 0.100971 Jul 21 06:36:58.276903 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 480/969] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 06:36:58 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/ips => generated 145 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:36:58.583789 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0db9a55a-d813-45ba-9a08-f818748d0b90 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:58.598473 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0db9a55a-d813-45ba-9a08-f818748d0b90 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:58.600178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0db9a55a-d813-45ba-9a08-f818748d0b90 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:58.609545 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0db9a55a-d813-45ba-9a08-f818748d0b90 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.418203 Jul 21 06:36:58.625622 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 490/970] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:58 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:36:59.632902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5493db34-2f8d-4c64-9305-a9220636985d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:36:59.634371 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5493db34-2f8d-4c64-9305-a9220636985d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:59.652516 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5493db34-2f8d-4c64-9305-a9220636985d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:59.659049 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5493db34-2f8d-4c64-9305-a9220636985d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:59.660491 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5493db34-2f8d-4c64-9305-a9220636985d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:59.661097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5493db34-2f8d-4c64-9305-a9220636985d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:59.817188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-777b2da3-461a-4279-9d64-3ecf32ada8bc tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a27422a-2816-4cda-84ad-9ffd64e7a253"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:36:59.818677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-777b2da3-461a-4279-9d64-3ecf32ada8bc tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:36:59.831189 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-777b2da3-461a-4279-9d64-3ecf32ada8bc tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:59.831635 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-777b2da3-461a-4279-9d64-3ecf32ada8bc tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:59.832418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-777b2da3-461a-4279-9d64-3ecf32ada8bc tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:36:59.836294 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-777b2da3-461a-4279-9d64-3ecf32ada8bc tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:36:59.936763 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5493db34-2f8d-4c64-9305-a9220636985d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:59.950192 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5493db34-2f8d-4c64-9305-a9220636985d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:59.953030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5493db34-2f8d-4c64-9305-a9220636985d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:36:59.957101 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5493db34-2f8d-4c64-9305-a9220636985d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.328129 Jul 21 06:36:59.962175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 481/971] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:36:59 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:00.238253 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:00.296886 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-777b2da3-461a-4279-9d64-3ecf32ada8bc tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483434 Jul 21 06:37:00.298343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 491/972] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:36:59 2022] POST /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:00.988973 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-bc5e1667-f71f-4f0b-af0e-476e83f85e74 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:00.989593 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-bc5e1667-f71f-4f0b-af0e-476e83f85e74 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:00.997797 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc5e1667-f71f-4f0b-af0e-476e83f85e74 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:00.998661 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc5e1667-f71f-4f0b-af0e-476e83f85e74 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:00.999675 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc5e1667-f71f-4f0b-af0e-476e83f85e74 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:01.000107 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc5e1667-f71f-4f0b-af0e-476e83f85e74 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:01.206254 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bc5e1667-f71f-4f0b-af0e-476e83f85e74 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:01.218158 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bc5e1667-f71f-4f0b-af0e-476e83f85e74 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:01.219988 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bc5e1667-f71f-4f0b-af0e-476e83f85e74 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:01.221605 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-bc5e1667-f71f-4f0b-af0e-476e83f85e74 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.243339 Jul 21 06:37:01.222203 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 482/973] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:00 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:02.241788 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1eff2f77-30be-44bc-8494-b8897a33df9c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:02.242515 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1eff2f77-30be-44bc-8494-b8897a33df9c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:02.245424 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:02.250682 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1eff2f77-30be-44bc-8494-b8897a33df9c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:02.251361 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1eff2f77-30be-44bc-8494-b8897a33df9c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:02.252332 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1eff2f77-30be-44bc-8494-b8897a33df9c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:02.252770 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1eff2f77-30be-44bc-8494-b8897a33df9c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:02.430977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1eff2f77-30be-44bc-8494-b8897a33df9c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:02.441511 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1eff2f77-30be-44bc-8494-b8897a33df9c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:02.444701 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1eff2f77-30be-44bc-8494-b8897a33df9c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:02.446065 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1eff2f77-30be-44bc-8494-b8897a33df9c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.208864 Jul 21 06:37:02.459042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 492/974] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:02 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:03.468768 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8d9969b8-9581-4149-aac5-9b8b233de283 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:03.470198 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8d9969b8-9581-4149-aac5-9b8b233de283 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:03.481096 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d9969b8-9581-4149-aac5-9b8b233de283 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:03.482251 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d9969b8-9581-4149-aac5-9b8b233de283 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:03.483269 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d9969b8-9581-4149-aac5-9b8b233de283 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:03.483937 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8d9969b8-9581-4149-aac5-9b8b233de283 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:03.770376 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8d9969b8-9581-4149-aac5-9b8b233de283 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:03.782613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8d9969b8-9581-4149-aac5-9b8b233de283 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:03.784191 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8d9969b8-9581-4149-aac5-9b8b233de283 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:03.785332 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8d9969b8-9581-4149-aac5-9b8b233de283 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.321641 Jul 21 06:37:03.786281 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 483/975] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:03 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:37:04.805022 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c38f1135-e921-4a1b-9651-5ce3bf6b4446 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:04.805643 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c38f1135-e921-4a1b-9651-5ce3bf6b4446 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:04.813420 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c38f1135-e921-4a1b-9651-5ce3bf6b4446 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:04.814198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c38f1135-e921-4a1b-9651-5ce3bf6b4446 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:04.815189 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c38f1135-e921-4a1b-9651-5ce3bf6b4446 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:04.815826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c38f1135-e921-4a1b-9651-5ce3bf6b4446 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:04.967890 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c38f1135-e921-4a1b-9651-5ce3bf6b4446 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:04.977108 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c38f1135-e921-4a1b-9651-5ce3bf6b4446 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:04.979358 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c38f1135-e921-4a1b-9651-5ce3bf6b4446 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:04.980109 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c38f1135-e921-4a1b-9651-5ce3bf6b4446 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.179159 Jul 21 06:37:04.980671 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 493/976] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:04 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:05.999936 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-87a086b5-d54d-4f8c-806d-8153718e6352 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:06.000613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-87a086b5-d54d-4f8c-806d-8153718e6352 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:06.007298 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-87a086b5-d54d-4f8c-806d-8153718e6352 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:06.007760 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-87a086b5-d54d-4f8c-806d-8153718e6352 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:06.008541 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-87a086b5-d54d-4f8c-806d-8153718e6352 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:06.008981 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-87a086b5-d54d-4f8c-806d-8153718e6352 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:06.162957 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-87a086b5-d54d-4f8c-806d-8153718e6352 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:06.171431 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-87a086b5-d54d-4f8c-806d-8153718e6352 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:06.172921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-87a086b5-d54d-4f8c-806d-8153718e6352 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:06.174098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-87a086b5-d54d-4f8c-806d-8153718e6352 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1740 microversion: 2.20 time: 0.178578 Jul 21 06:37:06.174656 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 484/977] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:05 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:07.192854 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-942f08e6-f16a-4ebb-95f2-1d3d6225341c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:07.193478 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-942f08e6-f16a-4ebb-95f2-1d3d6225341c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:07.200196 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-942f08e6-f16a-4ebb-95f2-1d3d6225341c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:07.200689 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-942f08e6-f16a-4ebb-95f2-1d3d6225341c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:07.202044 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-942f08e6-f16a-4ebb-95f2-1d3d6225341c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:07.202489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-942f08e6-f16a-4ebb-95f2-1d3d6225341c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:07.354478 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-942f08e6-f16a-4ebb-95f2-1d3d6225341c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:07.368195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-942f08e6-f16a-4ebb-95f2-1d3d6225341c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:07.373273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-942f08e6-f16a-4ebb-95f2-1d3d6225341c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:07.376417 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-942f08e6-f16a-4ebb-95f2-1d3d6225341c tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1722 microversion: 2.20 time: 0.186971 Jul 21 06:37:07.377620 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 494/978] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:07 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:37:08.009675 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c9a72f94-be68-45ec-8be6-c039962eb7db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:08.010638 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c9a72f94-be68-45ec-8be6-c039962eb7db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:08.018102 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c9a72f94-be68-45ec-8be6-c039962eb7db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:08.018560 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c9a72f94-be68-45ec-8be6-c039962eb7db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:08.019335 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c9a72f94-be68-45ec-8be6-c039962eb7db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:08.019774 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c9a72f94-be68-45ec-8be6-c039962eb7db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:08.049585 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c9a72f94-be68-45ec-8be6-c039962eb7db tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 Jul 21 06:37:08.050198 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 485/979] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:37:08 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:08.060204 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-10277f0c-618d-4cb2-9c44-ddeadf65ab2a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:08.060698 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-10277f0c-618d-4cb2-9c44-ddeadf65ab2a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:08.063670 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=4 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:08.069169 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10277f0c-618d-4cb2-9c44-ddeadf65ab2a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:08.069612 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10277f0c-618d-4cb2-9c44-ddeadf65ab2a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:08.070513 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10277f0c-618d-4cb2-9c44-ddeadf65ab2a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:08.070954 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-10277f0c-618d-4cb2-9c44-ddeadf65ab2a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:08.100057 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-10277f0c-618d-4cb2-9c44-ddeadf65ab2a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments/8a27422a-2816-4cda-84ad-9ffd64e7a253" status: 200 len: 194 microversion: 2.1 time: 0.043921 Jul 21 06:37:08.100631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 495/980] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Jul 21 06:37:08 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments/8a27422a-2816-4cda-84ad-9ffd64e7a253 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:08.395939 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e5803ddc-0be4-43e4-a7d8-cc876a9b6cd5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:08.396571 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e5803ddc-0be4-43e4-a7d8-cc876a9b6cd5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:08.402912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e5803ddc-0be4-43e4-a7d8-cc876a9b6cd5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:08.403367 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e5803ddc-0be4-43e4-a7d8-cc876a9b6cd5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:08.404140 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e5803ddc-0be4-43e4-a7d8-cc876a9b6cd5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:08.404610 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e5803ddc-0be4-43e4-a7d8-cc876a9b6cd5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:08.535437 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e5803ddc-0be4-43e4-a7d8-cc876a9b6cd5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:08.543287 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e5803ddc-0be4-43e4-a7d8-cc876a9b6cd5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:08.544806 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e5803ddc-0be4-43e4-a7d8-cc876a9b6cd5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:08.546647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e5803ddc-0be4-43e4-a7d8-cc876a9b6cd5 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1722 microversion: 2.20 time: 0.154500 Jul 21 06:37:08.547202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 486/981] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:08 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:09.437654 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-127b037c-039c-46c9-8b5a-a9e3cc09d8cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2b39938-0334-4aeb-b777-3536706fce10"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:09.438719 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-127b037c-039c-46c9-8b5a-a9e3cc09d8cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:09.445519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-127b037c-039c-46c9-8b5a-a9e3cc09d8cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:09.445987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-127b037c-039c-46c9-8b5a-a9e3cc09d8cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:09.446763 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-127b037c-039c-46c9-8b5a-a9e3cc09d8cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:09.447206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-127b037c-039c-46c9-8b5a-a9e3cc09d8cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:09.474255 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-0964e2e8-1d05-441d-ba5c-7d905be33449 req-d15ec753-21a5-4be4-b74d-4a5156f677f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ff60b2-b16b-481d-8396-016f9068bff1", "name": "network-vif-unplugged", "status": "completed", "tag": "4aee29c5-9551-4f05-a973-a575a8c0fa54"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:09.491482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-0964e2e8-1d05-441d-ba5c-7d905be33449 req-d15ec753-21a5-4be4-b74d-4a5156f677f9 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:09.492081 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-0964e2e8-1d05-441d-ba5c-7d905be33449 req-d15ec753-21a5-4be4-b74d-4a5156f677f9 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:09.517814 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-0964e2e8-1d05-441d-ba5c-7d905be33449 req-d15ec753-21a5-4be4-b74d-4a5156f677f9 service nova] Creating event network-vif-unplugged:4aee29c5-9551-4f05-a973-a575a8c0fa54 for instance d6ff60b2-b16b-481d-8396-016f9068bff1 on hv-cinder-85031 Jul 21 06:37:09.529666 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-0964e2e8-1d05-441d-ba5c-7d905be33449 req-d15ec753-21a5-4be4-b74d-4a5156f677f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059514 Jul 21 06:37:09.531145 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 487/982] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:37:09.566558 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-48d4d2f5-09ce-4421-925d-256fe4df27ef tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:09.566730 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-48d4d2f5-09ce-4421-925d-256fe4df27ef tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:09.573206 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-48d4d2f5-09ce-4421-925d-256fe4df27ef tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:09.573658 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-48d4d2f5-09ce-4421-925d-256fe4df27ef tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:09.574602 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-48d4d2f5-09ce-4421-925d-256fe4df27ef tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:09.575048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-48d4d2f5-09ce-4421-925d-256fe4df27ef tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:09.727140 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-48d4d2f5-09ce-4421-925d-256fe4df27ef tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:09.736199 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-48d4d2f5-09ce-4421-925d-256fe4df27ef tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:09.737793 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-48d4d2f5-09ce-4421-925d-256fe4df27ef tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:09.739068 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-48d4d2f5-09ce-4421-925d-256fe4df27ef tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1725 microversion: 2.20 time: 0.178222 Jul 21 06:37:09.740013 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 488/983] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:09 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:37:09.758067 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-65c041ed-d925-4e72-81b6-e98e6be1bcd4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65d574c3-fd7a-41bb-9a47-31e53b5089bd"}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:09.759356 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-65c041ed-d925-4e72-81b6-e98e6be1bcd4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:09.767687 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-65c041ed-d925-4e72-81b6-e98e6be1bcd4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:09.768431 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-65c041ed-d925-4e72-81b6-e98e6be1bcd4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:09.769516 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-65c041ed-d925-4e72-81b6-e98e6be1bcd4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:09.771349 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-65c041ed-d925-4e72-81b6-e98e6be1bcd4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:09.797110 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-127b037c-039c-46c9-8b5a-a9e3cc09d8cd tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "POST /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365511 Jul 21 06:37:09.797729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 496/984] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:37:09 2022] POST /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:10.089216 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-65c041ed-d925-4e72-81b6-e98e6be1bcd4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "POST /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335999 Jul 21 06:37:10.089823 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 489/985] 10.222.0.42 () {62 vars in 1363 bytes} [Thu Jul 21 06:37:09 2022] POST /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/os-volume_attachments => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 06:37:10.216880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3063a4c0-5ce0-4600-9a4f-f13f843a435e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:10.218105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3063a4c0-5ce0-4600-9a4f-f13f843a435e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:10.224291 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3063a4c0-5ce0-4600-9a4f-f13f843a435e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:10.224743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3063a4c0-5ce0-4600-9a4f-f13f843a435e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:10.225503 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3063a4c0-5ce0-4600-9a4f-f13f843a435e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:10.225957 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3063a4c0-5ce0-4600-9a4f-f13f843a435e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:10.498427 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3063a4c0-5ce0-4600-9a4f-f13f843a435e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/os-volume_attachments/65d574c3-fd7a-41bb-9a47-31e53b5089bd" status: 202 len: 0 microversion: 2.20 time: 0.286767 Jul 21 06:37:10.499136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 497/986] 10.222.0.42 () {60 vars in 1456 bytes} [Thu Jul 21 06:37:10 2022] DELETE /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/os-volume_attachments/65d574c3-fd7a-41bb-9a47-31e53b5089bd => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:37:10.555505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7d01b44b-cb4b-4492-a169-0a7a799cb7d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:10.556077 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7d01b44b-cb4b-4492-a169-0a7a799cb7d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:10.562627 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d01b44b-cb4b-4492-a169-0a7a799cb7d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:10.563078 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d01b44b-cb4b-4492-a169-0a7a799cb7d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:10.563842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d01b44b-cb4b-4492-a169-0a7a799cb7d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:10.564283 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7d01b44b-cb4b-4492-a169-0a7a799cb7d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:10.657534 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7d01b44b-cb4b-4492-a169-0a7a799cb7d1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "POST /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/action" status: 202 len: 0 microversion: 2.20 time: 0.105847 Jul 21 06:37:10.661292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 490/987] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jul 21 06:37:10 2022] POST /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:37:10.667536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-eb5ab418-f159-4c5d-9579-36f8b7a3ff3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:10.668182 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-eb5ab418-f159-4c5d-9579-36f8b7a3ff3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:10.675761 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-eb5ab418-f159-4c5d-9579-36f8b7a3ff3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:10.676216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-eb5ab418-f159-4c5d-9579-36f8b7a3ff3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:10.676981 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-eb5ab418-f159-4c5d-9579-36f8b7a3ff3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:10.677446 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-eb5ab418-f159-4c5d-9579-36f8b7a3ff3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:10.860746 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-eb5ab418-f159-4c5d-9579-36f8b7a3ff3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:10.868969 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-eb5ab418-f159-4c5d-9579-36f8b7a3ff3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:10.870595 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-eb5ab418-f159-4c5d-9579-36f8b7a3ff3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:10.871752 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-eb5ab418-f159-4c5d-9579-36f8b7a3ff3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1673 microversion: 2.20 time: 0.208786 Jul 21 06:37:10.872337 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 498/988] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:10 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:37:11.893277 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c33cec7d-671e-435b-8b26-c19d5fdbf10a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:11.893906 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c33cec7d-671e-435b-8b26-c19d5fdbf10a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:11.902010 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c33cec7d-671e-435b-8b26-c19d5fdbf10a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:11.902854 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c33cec7d-671e-435b-8b26-c19d5fdbf10a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:11.903858 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c33cec7d-671e-435b-8b26-c19d5fdbf10a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:11.904366 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c33cec7d-671e-435b-8b26-c19d5fdbf10a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:12.047262 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c33cec7d-671e-435b-8b26-c19d5fdbf10a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:12.057400 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c33cec7d-671e-435b-8b26-c19d5fdbf10a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:12.059031 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c33cec7d-671e-435b-8b26-c19d5fdbf10a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:12.060626 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c33cec7d-671e-435b-8b26-c19d5fdbf10a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.172729 Jul 21 06:37:12.062066 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 491/989] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:11 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:13.080630 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-42981e5a-32de-49cc-8b55-ea4a11434a03 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:13.082177 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-42981e5a-32de-49cc-8b55-ea4a11434a03 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:13.088907 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-42981e5a-32de-49cc-8b55-ea4a11434a03 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:13.089622 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-42981e5a-32de-49cc-8b55-ea4a11434a03 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:13.090754 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-42981e5a-32de-49cc-8b55-ea4a11434a03 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:13.091363 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-42981e5a-32de-49cc-8b55-ea4a11434a03 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:13.285692 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-42981e5a-32de-49cc-8b55-ea4a11434a03 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:13.294447 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-42981e5a-32de-49cc-8b55-ea4a11434a03 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:13.299149 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-42981e5a-32de-49cc-8b55-ea4a11434a03 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:13.300816 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-42981e5a-32de-49cc-8b55-ea4a11434a03 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.224529 Jul 21 06:37:13.302813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 499/990] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:13 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:14.319206 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-307623e4-db4c-4a94-b63e-987c3154ec2b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:14.320420 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-307623e4-db4c-4a94-b63e-987c3154ec2b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:14.327547 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-307623e4-db4c-4a94-b63e-987c3154ec2b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:14.328878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-307623e4-db4c-4a94-b63e-987c3154ec2b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:14.329919 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-307623e4-db4c-4a94-b63e-987c3154ec2b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:14.330603 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-307623e4-db4c-4a94-b63e-987c3154ec2b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:14.474991 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-307623e4-db4c-4a94-b63e-987c3154ec2b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:14.482921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-307623e4-db4c-4a94-b63e-987c3154ec2b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:14.485195 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-307623e4-db4c-4a94-b63e-987c3154ec2b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:14.486391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-307623e4-db4c-4a94-b63e-987c3154ec2b tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.171136 Jul 21 06:37:14.486949 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 492/991] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:14 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:15.504561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f619f893-3d40-4748-8701-c3b4a8394ad1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:15.505143 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f619f893-3d40-4748-8701-c3b4a8394ad1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:15.511624 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f619f893-3d40-4748-8701-c3b4a8394ad1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:15.512065 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f619f893-3d40-4748-8701-c3b4a8394ad1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:15.512817 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f619f893-3d40-4748-8701-c3b4a8394ad1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:15.513249 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f619f893-3d40-4748-8701-c3b4a8394ad1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:15.649161 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f619f893-3d40-4748-8701-c3b4a8394ad1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:15.657967 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f619f893-3d40-4748-8701-c3b4a8394ad1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:15.659764 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f619f893-3d40-4748-8701-c3b4a8394ad1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:15.661168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f619f893-3d40-4748-8701-c3b4a8394ad1 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.160506 Jul 21 06:37:15.661732 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 500/992] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:15 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:16.679533 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-685e36e6-f180-4c81-b2de-6834a036fa9a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:16.680076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-685e36e6-f180-4c81-b2de-6834a036fa9a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:16.687121 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-685e36e6-f180-4c81-b2de-6834a036fa9a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:16.687659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-685e36e6-f180-4c81-b2de-6834a036fa9a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:16.688464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-685e36e6-f180-4c81-b2de-6834a036fa9a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:16.688900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-685e36e6-f180-4c81-b2de-6834a036fa9a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:16.830112 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-685e36e6-f180-4c81-b2de-6834a036fa9a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:16.842238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-685e36e6-f180-4c81-b2de-6834a036fa9a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:16.842238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-685e36e6-f180-4c81-b2de-6834a036fa9a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:16.842238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-685e36e6-f180-4c81-b2de-6834a036fa9a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.166043 Jul 21 06:37:16.843254 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 493/993] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:16 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:17.418171 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-161730357", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1626767190", "security_groups": [{"name": "tempest-secgroup-smoke-352240006"}], "networks": [{"uuid": "28e3c66a-9e49-48c3-be94-3809b043754b"}], "block_device_mapping_v2": [{"uuid": "42752c07-ebb5-446d-8640-adf29c974ec0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:17.553032 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] validate_networks() for [('28e3c66a-9e49-48c3-be94-3809b043754b', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:37:17.860701 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7feef335-7508-43fd-9476-06a847104af6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:17.861456 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7feef335-7508-43fd-9476-06a847104af6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:17.868373 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7feef335-7508-43fd-9476-06a847104af6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:17.868818 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7feef335-7508-43fd-9476-06a847104af6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:17.869851 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7feef335-7508-43fd-9476-06a847104af6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:17.870528 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7feef335-7508-43fd-9476-06a847104af6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:17.896811 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:18.038663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:37:18.039129 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:37:18.039605 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:37:18.040009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:37:18.040417 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:37:18.056746 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:18.065051 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:18.065051 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:18.065051 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:18.068987 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7feef335-7508-43fd-9476-06a847104af6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:18.083621 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7feef335-7508-43fd-9476-06a847104af6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:18.083621 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7feef335-7508-43fd-9476-06a847104af6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:18.099359 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7feef335-7508-43fd-9476-06a847104af6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.238833 Jul 21 06:37:18.118616 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 494/994] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:17 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:37:18.133731 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Getting quotas for project fd3a6e00103d49038260d28a680a9c56. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:37:18.138261 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Getting quotas for user 0f951e37e60145aba97bcd1ff8aad260 and project fd3a6e00103d49038260d28a680a9c56. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:37:18.227054 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:37:18.229126 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42752c07-ebb5-446d-8640-adf29c974ec0',volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:37:18.432661 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e385180b-7780-4010-9a61-d92acd0e7cf9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.018317 Jul 21 06:37:18.434459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 501/995] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:37:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:37:18.444453 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-26f1b05d-135f-4e23-85d0-5524b11f63cc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:18.445435 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-26f1b05d-135f-4e23-85d0-5524b11f63cc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:18.536930 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-26f1b05d-135f-4e23-85d0-5524b11f63cc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:18.546976 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-26f1b05d-135f-4e23-85d0-5524b11f63cc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1088 microversion: 2.1 time: 0.105672 Jul 21 06:37:18.548688 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 495/996] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:18 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1088 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:19.125561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-23579b0b-16b7-4914-986d-fe66daadcf7a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:19.126351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-23579b0b-16b7-4914-986d-fe66daadcf7a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:19.133067 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-23579b0b-16b7-4914-986d-fe66daadcf7a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:19.133519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-23579b0b-16b7-4914-986d-fe66daadcf7a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:19.134554 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-23579b0b-16b7-4914-986d-fe66daadcf7a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:19.135131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-23579b0b-16b7-4914-986d-fe66daadcf7a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:19.275276 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-23579b0b-16b7-4914-986d-fe66daadcf7a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:19.284394 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-23579b0b-16b7-4914-986d-fe66daadcf7a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:19.285905 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-23579b0b-16b7-4914-986d-fe66daadcf7a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:19.287106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-23579b0b-16b7-4914-986d-fe66daadcf7a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.166356 Jul 21 06:37:19.288010 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 502/997] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:19 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:19.565209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ed547582-0121-483a-b6d0-67079b76a882 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:19.565854 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ed547582-0121-483a-b6d0-67079b76a882 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:19.573238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed547582-0121-483a-b6d0-67079b76a882 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:19.573813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed547582-0121-483a-b6d0-67079b76a882 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:19.574626 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed547582-0121-483a-b6d0-67079b76a882 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:19.575076 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ed547582-0121-483a-b6d0-67079b76a882 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:19.639270 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ed547582-0121-483a-b6d0-67079b76a882 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:19.648582 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ed547582-0121-483a-b6d0-67079b76a882 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1138 microversion: 2.1 time: 0.087505 Jul 21 06:37:19.649285 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 496/998] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:19 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:37:20.306157 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-973262f9-94f1-488c-9b94-5ca5d6b763b4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:20.306766 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-973262f9-94f1-488c-9b94-5ca5d6b763b4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:20.313873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-973262f9-94f1-488c-9b94-5ca5d6b763b4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:20.314360 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-973262f9-94f1-488c-9b94-5ca5d6b763b4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:20.315148 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-973262f9-94f1-488c-9b94-5ca5d6b763b4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:20.315622 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-973262f9-94f1-488c-9b94-5ca5d6b763b4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:20.464077 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-973262f9-94f1-488c-9b94-5ca5d6b763b4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:20.475231 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-973262f9-94f1-488c-9b94-5ca5d6b763b4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:20.476790 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-973262f9-94f1-488c-9b94-5ca5d6b763b4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:20.477986 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-973262f9-94f1-488c-9b94-5ca5d6b763b4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.175885 Jul 21 06:37:20.478582 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 503/999] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:20 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:20.666792 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3dbc7ebb-337e-4b1a-8e54-009696d960fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:20.667374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3dbc7ebb-337e-4b1a-8e54-009696d960fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:20.675086 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3dbc7ebb-337e-4b1a-8e54-009696d960fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:20.675535 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3dbc7ebb-337e-4b1a-8e54-009696d960fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:20.676318 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3dbc7ebb-337e-4b1a-8e54-009696d960fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:20.676754 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3dbc7ebb-337e-4b1a-8e54-009696d960fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:20.759903 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3dbc7ebb-337e-4b1a-8e54-009696d960fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:20.768480 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3dbc7ebb-337e-4b1a-8e54-009696d960fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1138 microversion: 2.1 time: 0.105563 Jul 21 06:37:20.778641 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 497/1000] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:20 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1138 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:21.497579 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-55caf97e-a93b-4618-8249-157e45354b0d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:21.498787 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-55caf97e-a93b-4618-8249-157e45354b0d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:21.504984 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-55caf97e-a93b-4618-8249-157e45354b0d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:21.505437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-55caf97e-a93b-4618-8249-157e45354b0d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:21.506249 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-55caf97e-a93b-4618-8249-157e45354b0d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:21.506692 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-55caf97e-a93b-4618-8249-157e45354b0d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:21.640300 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-55caf97e-a93b-4618-8249-157e45354b0d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:21.642635 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:SELECT=89,nova_cell1:INSERT=4 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:21.650204 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-55caf97e-a93b-4618-8249-157e45354b0d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:21.652042 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-55caf97e-a93b-4618-8249-157e45354b0d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:21.653204 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-55caf97e-a93b-4618-8249-157e45354b0d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.159599 Jul 21 06:37:21.653760 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 504/1001] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:21 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:21.786161 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-89fdd4a9-3407-4b75-a9b9-ffb0a50725d4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:21.786789 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-89fdd4a9-3407-4b75-a9b9-ffb0a50725d4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:21.793367 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-89fdd4a9-3407-4b75-a9b9-ffb0a50725d4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:21.793983 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-89fdd4a9-3407-4b75-a9b9-ffb0a50725d4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:21.794756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-89fdd4a9-3407-4b75-a9b9-ffb0a50725d4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:21.795199 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-89fdd4a9-3407-4b75-a9b9-ffb0a50725d4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:21.865085 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-89fdd4a9-3407-4b75-a9b9-ffb0a50725d4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:21.872570 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-89fdd4a9-3407-4b75-a9b9-ffb0a50725d4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1138 microversion: 2.1 time: 0.090362 Jul 21 06:37:21.873144 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 498/1002] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:21 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1138 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:22.672869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-73bbd3a1-6d77-4749-aab8-377d0be397ba tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:22.673484 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-73bbd3a1-6d77-4749-aab8-377d0be397ba tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:22.680472 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73bbd3a1-6d77-4749-aab8-377d0be397ba tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:22.680921 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73bbd3a1-6d77-4749-aab8-377d0be397ba tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:22.681686 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73bbd3a1-6d77-4749-aab8-377d0be397ba tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:22.682153 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-73bbd3a1-6d77-4749-aab8-377d0be397ba tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:22.812659 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-73bbd3a1-6d77-4749-aab8-377d0be397ba tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:22.820521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-73bbd3a1-6d77-4749-aab8-377d0be397ba tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:22.822085 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-73bbd3a1-6d77-4749-aab8-377d0be397ba tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:22.823359 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-73bbd3a1-6d77-4749-aab8-377d0be397ba tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.155359 Jul 21 06:37:22.823921 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 505/1003] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:22 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:22.889149 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-bc2539cd-22e4-4ab8-b7ff-d3dafaaec87c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:22.889853 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-bc2539cd-22e4-4ab8-b7ff-d3dafaaec87c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:22.896297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc2539cd-22e4-4ab8-b7ff-d3dafaaec87c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:22.896752 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc2539cd-22e4-4ab8-b7ff-d3dafaaec87c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:22.897518 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc2539cd-22e4-4ab8-b7ff-d3dafaaec87c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:22.897978 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bc2539cd-22e4-4ab8-b7ff-d3dafaaec87c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:22.959005 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bc2539cd-22e4-4ab8-b7ff-d3dafaaec87c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:22.966332 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-bc2539cd-22e4-4ab8-b7ff-d3dafaaec87c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1130 microversion: 2.1 time: 0.080948 Jul 21 06:37:22.966895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 499/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:22 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1130 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:23.841894 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e2292a35-baa3-4299-adc7-e6bfcc4666f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:23.842632 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e2292a35-baa3-4299-adc7-e6bfcc4666f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:23.849236 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e2292a35-baa3-4299-adc7-e6bfcc4666f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:23.849696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e2292a35-baa3-4299-adc7-e6bfcc4666f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:23.850636 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e2292a35-baa3-4299-adc7-e6bfcc4666f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:23.851078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e2292a35-baa3-4299-adc7-e6bfcc4666f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:23.981867 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e2292a35-baa3-4299-adc7-e6bfcc4666f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:23.983951 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a272783a-25e1-4b82-aeae-dfd56854ad5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:23.984574 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a272783a-25e1-4b82-aeae-dfd56854ad5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:23.990195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e2292a35-baa3-4299-adc7-e6bfcc4666f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:23.990709 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a272783a-25e1-4b82-aeae-dfd56854ad5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:23.991160 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a272783a-25e1-4b82-aeae-dfd56854ad5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:23.991702 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e2292a35-baa3-4299-adc7-e6bfcc4666f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:23.991927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a272783a-25e1-4b82-aeae-dfd56854ad5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:23.992367 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a272783a-25e1-4b82-aeae-dfd56854ad5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:23.992892 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e2292a35-baa3-4299-adc7-e6bfcc4666f8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.155051 Jul 21 06:37:23.993456 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 506/1005] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:23 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:24.053640 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a272783a-25e1-4b82-aeae-dfd56854ad5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:24.061205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a272783a-25e1-4b82-aeae-dfd56854ad5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1186 microversion: 2.1 time: 0.081235 Jul 21 06:37:24.062345 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 500/1006] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:23 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:24.798117 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-04220ce8-3bce-4afc-a433-a80b95b19ae5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:24.799102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-04220ce8-3bce-4afc-a433-a80b95b19ae5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:24.805092 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-04220ce8-3bce-4afc-a433-a80b95b19ae5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:24.805537 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-04220ce8-3bce-4afc-a433-a80b95b19ae5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:24.806331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-04220ce8-3bce-4afc-a433-a80b95b19ae5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:24.806765 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-04220ce8-3bce-4afc-a433-a80b95b19ae5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:24.837518 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-04220ce8-3bce-4afc-a433-a80b95b19ae5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043473 Jul 21 06:37:24.838103 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 507/1007] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:37:24 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:24.985412 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ad602ce7-ccb0-47e1-9e1b-407eddbf55c4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:24.986601 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ad602ce7-ccb0-47e1-9e1b-407eddbf55c4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:24.993507 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ad602ce7-ccb0-47e1-9e1b-407eddbf55c4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:24.994272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ad602ce7-ccb0-47e1-9e1b-407eddbf55c4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:24.995238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ad602ce7-ccb0-47e1-9e1b-407eddbf55c4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:24.995839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ad602ce7-ccb0-47e1-9e1b-407eddbf55c4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:25.014283 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-02e48265-cdba-4d93-800b-a4696e695be8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:25.016087 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-02e48265-cdba-4d93-800b-a4696e695be8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:25.030037 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-02e48265-cdba-4d93-800b-a4696e695be8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:25.030401 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-02e48265-cdba-4d93-800b-a4696e695be8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:25.031191 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-02e48265-cdba-4d93-800b-a4696e695be8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:25.031631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-02e48265-cdba-4d93-800b-a4696e695be8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:25.062358 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ad602ce7-ccb0-47e1-9e1b-407eddbf55c4 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments/8a27422a-2816-4cda-84ad-9ffd64e7a253" status: 200 len: 194 microversion: 2.1 time: 0.080192 Jul 21 06:37:25.062532 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 501/1008] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Jul 21 06:37:24 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments/8a27422a-2816-4cda-84ad-9ffd64e7a253 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:25.078135 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a618a520-799e-4ebd-a8d7-83ae052382d1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:25.078730 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a618a520-799e-4ebd-a8d7-83ae052382d1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:25.085245 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a618a520-799e-4ebd-a8d7-83ae052382d1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:25.085899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a618a520-799e-4ebd-a8d7-83ae052382d1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:25.086879 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a618a520-799e-4ebd-a8d7-83ae052382d1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:25.087553 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a618a520-799e-4ebd-a8d7-83ae052382d1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:25.191618 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-a618a520-799e-4ebd-a8d7-83ae052382d1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lazy-loading 'services' on Instance uuid efabe894-210e-4604-a672-71967b164f19 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:37:25.268395 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a618a520-799e-4ebd-a8d7-83ae052382d1 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "DELETE /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments/8a27422a-2816-4cda-84ad-9ffd64e7a253" status: 202 len: 0 microversion: 2.1 time: 0.196220 Jul 21 06:37:25.272272 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 502/1009] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:37:25 2022] DELETE /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments/8a27422a-2816-4cda-84ad-9ffd64e7a253 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:37:25.274751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e4650f51-6cea-4663-9d83-55750bae98b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:25.275900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e4650f51-6cea-4663-9d83-55750bae98b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:25.277342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-02e48265-cdba-4d93-800b-a4696e695be8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:25.285075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e4650f51-6cea-4663-9d83-55750bae98b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:25.285893 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e4650f51-6cea-4663-9d83-55750bae98b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:25.287093 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e4650f51-6cea-4663-9d83-55750bae98b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:25.287919 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e4650f51-6cea-4663-9d83-55750bae98b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:25.289147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-02e48265-cdba-4d93-800b-a4696e695be8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:25.291147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-02e48265-cdba-4d93-800b-a4696e695be8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:25.292666 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-02e48265-cdba-4d93-800b-a4696e695be8 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.283903 Jul 21 06:37:25.293788 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 508/1010] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:25 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:37:25.564609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-e4650f51-6cea-4663-9d83-55750bae98b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:25.576512 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e4650f51-6cea-4663-9d83-55750bae98b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1271 microversion: 2.1 time: 0.305550 Jul 21 06:37:25.578108 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 503/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:25 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:25.926616 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-1a21efaf-2db9-4a4b-9759-9e193c910dd1 req-9d2380a9-14ea-4783-a6d7-dfc70c711991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d4bc012-5129-4651-97ea-340f735e5e53", "tag": "a91746a4-9dc2-4a55-966c-ce5ac2be362d"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:25.943706 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-1a21efaf-2db9-4a4b-9759-9e193c910dd1 req-9d2380a9-14ea-4783-a6d7-dfc70c711991 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:25.944000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-1a21efaf-2db9-4a4b-9759-9e193c910dd1 req-9d2380a9-14ea-4783-a6d7-dfc70c711991 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:25.965175 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-1a21efaf-2db9-4a4b-9759-9e193c910dd1 req-9d2380a9-14ea-4783-a6d7-dfc70c711991 service nova] Creating event network-changed:a91746a4-9dc2-4a55-966c-ce5ac2be362d for instance 1d4bc012-5129-4651-97ea-340f735e5e53 on hv-cinder-85031 Jul 21 06:37:25.971417 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-1a21efaf-2db9-4a4b-9759-9e193c910dd1 req-9d2380a9-14ea-4783-a6d7-dfc70c711991 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048397 Jul 21 06:37:25.972360 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 509/1012] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:26.313902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-04de5909-9278-4536-9ea8-821961ea14db tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:26.314813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-04de5909-9278-4536-9ea8-821961ea14db tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:26.321680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-04de5909-9278-4536-9ea8-821961ea14db tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:26.322186 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-04de5909-9278-4536-9ea8-821961ea14db tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:26.322977 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-04de5909-9278-4536-9ea8-821961ea14db tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:26.323421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-04de5909-9278-4536-9ea8-821961ea14db tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:26.530842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-04de5909-9278-4536-9ea8-821961ea14db tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:26.538934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-04de5909-9278-4536-9ea8-821961ea14db tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:26.540446 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-04de5909-9278-4536-9ea8-821961ea14db tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:26.541614 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-04de5909-9278-4536-9ea8-821961ea14db tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.232189 Jul 21 06:37:26.542561 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 504/1013] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:26 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:26.596448 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-192bbbe0-6851-42d7-b7dd-19ce0e5b868a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:26.597195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-192bbbe0-6851-42d7-b7dd-19ce0e5b868a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:26.603417 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-192bbbe0-6851-42d7-b7dd-19ce0e5b868a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:26.603874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-192bbbe0-6851-42d7-b7dd-19ce0e5b868a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:26.604644 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-192bbbe0-6851-42d7-b7dd-19ce0e5b868a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:26.605086 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-192bbbe0-6851-42d7-b7dd-19ce0e5b868a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:27.052776 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-192bbbe0-6851-42d7-b7dd-19ce0e5b868a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:27.060550 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-192bbbe0-6851-42d7-b7dd-19ce0e5b868a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.470124 Jul 21 06:37:27.061139 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 510/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:26 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:27.464789 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ee4f19b6-e4b3-4af3-9747-5a22f4c2ecd2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:27.465314 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ee4f19b6-e4b3-4af3-9747-5a22f4c2ecd2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:27.472739 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ee4f19b6-e4b3-4af3-9747-5a22f4c2ecd2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:27.473204 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ee4f19b6-e4b3-4af3-9747-5a22f4c2ecd2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:27.474002 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ee4f19b6-e4b3-4af3-9747-5a22f4c2ecd2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:27.474443 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ee4f19b6-e4b3-4af3-9747-5a22f4c2ecd2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:27.504444 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ee4f19b6-e4b3-4af3-9747-5a22f4c2ecd2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments/b2b39938-0334-4aeb-b777-3536706fce10" status: 200 len: 194 microversion: 2.1 time: 0.043349 Jul 21 06:37:27.505142 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 505/1015] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Jul 21 06:37:27 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments/b2b39938-0334-4aeb-b777-3536706fce10 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:27.515119 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4180e2c3-9b1e-48d3-8829-5bfca5541ea5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:27.515623 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4180e2c3-9b1e-48d3-8829-5bfca5541ea5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:27.521657 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4180e2c3-9b1e-48d3-8829-5bfca5541ea5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:27.522147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4180e2c3-9b1e-48d3-8829-5bfca5541ea5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:27.522929 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4180e2c3-9b1e-48d3-8829-5bfca5541ea5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:27.523372 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4180e2c3-9b1e-48d3-8829-5bfca5541ea5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:27.539663 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-7c953433-dd15-4d09-ae6d-327085bc31cf req-2edb2cb6-3eb4-4d30-921e-aa846f487de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ff60b2-b16b-481d-8396-016f9068bff1", "name": "network-vif-plugged", "status": "completed", "tag": "4aee29c5-9551-4f05-a973-a575a8c0fa54"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:27.549450 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-7c953433-dd15-4d09-ae6d-327085bc31cf req-2edb2cb6-3eb4-4d30-921e-aa846f487de5 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:27.550178 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-7c953433-dd15-4d09-ae6d-327085bc31cf req-2edb2cb6-3eb4-4d30-921e-aa846f487de5 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:27.566342 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-7c953433-dd15-4d09-ae6d-327085bc31cf req-2edb2cb6-3eb4-4d30-921e-aa846f487de5 service nova] Creating event network-vif-plugged:4aee29c5-9551-4f05-a973-a575a8c0fa54 for instance d6ff60b2-b16b-481d-8396-016f9068bff1 on hv-cinder-85031 Jul 21 06:37:27.571996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-7c953433-dd15-4d09-ae6d-327085bc31cf req-2edb2cb6-3eb4-4d30-921e-aa846f487de5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036119 Jul 21 06:37:27.573048 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 506/1016] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:27.578178 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-df9c5b11-316a-4cbd-a1cb-44152a79c10f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:27.578888 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-df9c5b11-316a-4cbd-a1cb-44152a79c10f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:27.585316 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df9c5b11-316a-4cbd-a1cb-44152a79c10f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:27.585774 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df9c5b11-316a-4cbd-a1cb-44152a79c10f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:27.586595 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df9c5b11-316a-4cbd-a1cb-44152a79c10f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:27.587038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-df9c5b11-316a-4cbd-a1cb-44152a79c10f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:27.628422 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-4180e2c3-9b1e-48d3-8829-5bfca5541ea5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lazy-loading 'services' on Instance uuid efabe894-210e-4604-a672-71967b164f19 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:37:27.709404 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4180e2c3-9b1e-48d3-8829-5bfca5541ea5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "DELETE /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments/b2b39938-0334-4aeb-b777-3536706fce10" status: 202 len: 0 microversion: 2.1 time: 0.198176 Jul 21 06:37:27.710773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 511/1017] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:37:27 2022] DELETE /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments/b2b39938-0334-4aeb-b777-3536706fce10 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:37:27.822831 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-df9c5b11-316a-4cbd-a1cb-44152a79c10f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:27.850248 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-df9c5b11-316a-4cbd-a1cb-44152a79c10f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:27.852220 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-df9c5b11-316a-4cbd-a1cb-44152a79c10f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:27.853593 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-df9c5b11-316a-4cbd-a1cb-44152a79c10f tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.279615 Jul 21 06:37:27.855668 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 507/1018] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:27 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:28.079105 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-886c165c-ae53-4453-850b-3d25b2e5b8c1 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:28.079800 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-886c165c-ae53-4453-850b-3d25b2e5b8c1 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:28.086094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-886c165c-ae53-4453-850b-3d25b2e5b8c1 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:28.086543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-886c165c-ae53-4453-850b-3d25b2e5b8c1 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:28.087298 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-886c165c-ae53-4453-850b-3d25b2e5b8c1 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:28.087730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-886c165c-ae53-4453-850b-3d25b2e5b8c1 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:28.120566 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:28.147237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=6 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:28.221995 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-886c165c-ae53-4453-850b-3d25b2e5b8c1 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:28.229477 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-886c165c-ae53-4453-850b-3d25b2e5b8c1 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.155263 Jul 21 06:37:28.230071 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 512/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:28 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:28.873625 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0bc665b3-cfbc-4a32-82e7-6a7e74a95e44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:28.874880 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0bc665b3-cfbc-4a32-82e7-6a7e74a95e44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:28.877402 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:28.882917 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0bc665b3-cfbc-4a32-82e7-6a7e74a95e44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:28.883374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0bc665b3-cfbc-4a32-82e7-6a7e74a95e44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:28.884152 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0bc665b3-cfbc-4a32-82e7-6a7e74a95e44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:28.884602 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0bc665b3-cfbc-4a32-82e7-6a7e74a95e44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:29.021240 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0bc665b3-cfbc-4a32-82e7-6a7e74a95e44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:29.029438 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0bc665b3-cfbc-4a32-82e7-6a7e74a95e44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:29.031203 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0bc665b3-cfbc-4a32-82e7-6a7e74a95e44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:29.032358 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0bc665b3-cfbc-4a32-82e7-6a7e74a95e44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1731 microversion: 2.20 time: 0.162625 Jul 21 06:37:29.032924 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 508/1020] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:28 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:29.246511 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c3a62467-cd84-4d53-b42e-5fb9191ae714 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:29.247123 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c3a62467-cd84-4d53-b42e-5fb9191ae714 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:29.254475 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c3a62467-cd84-4d53-b42e-5fb9191ae714 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:29.254934 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c3a62467-cd84-4d53-b42e-5fb9191ae714 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:29.255699 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c3a62467-cd84-4d53-b42e-5fb9191ae714 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:29.256137 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c3a62467-cd84-4d53-b42e-5fb9191ae714 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:29.391116 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c3a62467-cd84-4d53-b42e-5fb9191ae714 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:29.398869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c3a62467-cd84-4d53-b42e-5fb9191ae714 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.156149 Jul 21 06:37:29.399450 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 513/1021] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:29 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:29.936464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-e3f73a39-fac7-42b2-974a-f1d00afc7ce9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:29.937468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-e3f73a39-fac7-42b2-974a-f1d00afc7ce9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:29.940309 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=62 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:29.945710 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e3f73a39-fac7-42b2-974a-f1d00afc7ce9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:29.946189 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e3f73a39-fac7-42b2-974a-f1d00afc7ce9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:29.946964 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e3f73a39-fac7-42b2-974a-f1d00afc7ce9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:29.947409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-e3f73a39-fac7-42b2-974a-f1d00afc7ce9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:29.977453 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-e3f73a39-fac7-42b2-974a-f1d00afc7ce9 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044958 Jul 21 06:37:29.982902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 509/1022] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:37:29 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:37:30.053029 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dab861bb-55bc-4271-a58d-1531ea0d7d3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:30.054328 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dab861bb-55bc-4271-a58d-1531ea0d7d3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:30.060836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dab861bb-55bc-4271-a58d-1531ea0d7d3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:30.061210 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dab861bb-55bc-4271-a58d-1531ea0d7d3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:30.063955 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dab861bb-55bc-4271-a58d-1531ea0d7d3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:30.064555 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dab861bb-55bc-4271-a58d-1531ea0d7d3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:30.088129 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2fbe124f-af4a-48ae-96a2-6a5364d3c804 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:30.089054 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2fbe124f-af4a-48ae-96a2-6a5364d3c804 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:30.095738 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fbe124f-af4a-48ae-96a2-6a5364d3c804 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:30.096194 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fbe124f-af4a-48ae-96a2-6a5364d3c804 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:30.096964 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fbe124f-af4a-48ae-96a2-6a5364d3c804 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:30.097403 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fbe124f-af4a-48ae-96a2-6a5364d3c804 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:30.127641 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2fbe124f-af4a-48ae-96a2-6a5364d3c804 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043230 Jul 21 06:37:30.128100 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 510/1023] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:37:30 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:37:30.193341 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2cfc706f-0c2b-41e1-9649-3e57c2044719 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:30.193931 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2cfc706f-0c2b-41e1-9649-3e57c2044719 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:30.199993 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2cfc706f-0c2b-41e1-9649-3e57c2044719 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:30.200517 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2cfc706f-0c2b-41e1-9649-3e57c2044719 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:30.201440 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2cfc706f-0c2b-41e1-9649-3e57c2044719 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:30.201964 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2cfc706f-0c2b-41e1-9649-3e57c2044719 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:30.205018 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dab861bb-55bc-4271-a58d-1531ea0d7d3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:30.212994 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dab861bb-55bc-4271-a58d-1531ea0d7d3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:30.214622 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dab861bb-55bc-4271-a58d-1531ea0d7d3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:30.215903 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dab861bb-55bc-4271-a58d-1531ea0d7d3e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1718 microversion: 2.20 time: 0.169698 Jul 21 06:37:30.216537 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 514/1024] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:37:30 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1718 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:37:30.229405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2cfc706f-0c2b-41e1-9649-3e57c2044719 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:37:30.243117 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:30.306298 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2cfc706f-0c2b-41e1-9649-3e57c2044719 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "DELETE /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 204 len: 0 microversion: 2.1 time: 0.116503 Jul 21 06:37:30.306883 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 511/1025] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:37:30 2022] DELETE /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 06:37:30.315956 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-79692e6d-5c47-4432-a1a0-f2a60a7fbd35 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:30.316579 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-79692e6d-5c47-4432-a1a0-f2a60a7fbd35 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:30.322944 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-79692e6d-5c47-4432-a1a0-f2a60a7fbd35 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:30.323393 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-79692e6d-5c47-4432-a1a0-f2a60a7fbd35 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:30.324147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-79692e6d-5c47-4432-a1a0-f2a60a7fbd35 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:30.324582 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-79692e6d-5c47-4432-a1a0-f2a60a7fbd35 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:30.416703 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2fd06edd-4c9e-4dd4-af8b-acda5b84883c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:30.417412 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2fd06edd-4c9e-4dd4-af8b-acda5b84883c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:30.424163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fd06edd-4c9e-4dd4-af8b-acda5b84883c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:30.424607 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fd06edd-4c9e-4dd4-af8b-acda5b84883c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:30.425392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fd06edd-4c9e-4dd4-af8b-acda5b84883c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:30.425836 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2fd06edd-4c9e-4dd4-af8b-acda5b84883c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:30.454975 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-79692e6d-5c47-4432-a1a0-f2a60a7fbd35 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:30.462489 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-79692e6d-5c47-4432-a1a0-f2a60a7fbd35 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1674 microversion: 2.1 time: 0.151067 Jul 21 06:37:30.463248 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 515/1026] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:30 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:37:30.558362 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2fd06edd-4c9e-4dd4-af8b-acda5b84883c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:30.565876 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2fd06edd-4c9e-4dd4-af8b-acda5b84883c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.153348 Jul 21 06:37:30.566468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 512/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:30 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:37:31.100907 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-423b4949-e471-4327-a35f-4cdfb6aa7902 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:31.101414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-423b4949-e471-4327-a35f-4cdfb6aa7902 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:31.107545 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-423b4949-e471-4327-a35f-4cdfb6aa7902 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:31.107995 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-423b4949-e471-4327-a35f-4cdfb6aa7902 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:31.109044 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-423b4949-e471-4327-a35f-4cdfb6aa7902 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:31.109481 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-423b4949-e471-4327-a35f-4cdfb6aa7902 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:31.132418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-423b4949-e471-4327-a35f-4cdfb6aa7902 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/ips" status: 200 len: 151 microversion: 2.1 time: 0.035342 Jul 21 06:37:31.134239 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 516/1028] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 06:37:31 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:31.479689 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ce013224-e8a3-40e1-9d25-930eaf4a1b50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:31.480307 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ce013224-e8a3-40e1-9d25-930eaf4a1b50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:31.487388 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce013224-e8a3-40e1-9d25-930eaf4a1b50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:31.487841 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce013224-e8a3-40e1-9d25-930eaf4a1b50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:31.488602 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce013224-e8a3-40e1-9d25-930eaf4a1b50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:31.489038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ce013224-e8a3-40e1-9d25-930eaf4a1b50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:31.582553 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7a01ddfa-884f-451f-b7e1-d5fbb1dfc38a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:31.583174 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7a01ddfa-884f-451f-b7e1-d5fbb1dfc38a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:31.589667 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a01ddfa-884f-451f-b7e1-d5fbb1dfc38a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:31.590154 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a01ddfa-884f-451f-b7e1-d5fbb1dfc38a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:31.590915 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a01ddfa-884f-451f-b7e1-d5fbb1dfc38a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:31.591352 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7a01ddfa-884f-451f-b7e1-d5fbb1dfc38a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:31.626709 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ce013224-e8a3-40e1-9d25-930eaf4a1b50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:31.634397 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ce013224-e8a3-40e1-9d25-930eaf4a1b50 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1674 microversion: 2.1 time: 0.158511 Jul 21 06:37:31.634975 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 513/1029] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:31 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:31.729293 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7a01ddfa-884f-451f-b7e1-d5fbb1dfc38a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:31.737218 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7a01ddfa-884f-451f-b7e1-d5fbb1dfc38a tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.158602 Jul 21 06:37:31.737784 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 517/1030] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:31 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:32.449920 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2c0b0468-1619-435c-b89f-b40fd96f138a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25d72b42-409a-4b43-808c-415b01105651"}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:32.451176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2c0b0468-1619-435c-b89f-b40fd96f138a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:32.457450 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2c0b0468-1619-435c-b89f-b40fd96f138a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:32.458012 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2c0b0468-1619-435c-b89f-b40fd96f138a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:32.458857 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2c0b0468-1619-435c-b89f-b40fd96f138a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:32.459386 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2c0b0468-1619-435c-b89f-b40fd96f138a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:32.652266 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bf451fbe-8357-4c36-b854-522102a25e5e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:32.652815 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bf451fbe-8357-4c36-b854-522102a25e5e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:32.656570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:32.660647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bf451fbe-8357-4c36-b854-522102a25e5e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:32.661090 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bf451fbe-8357-4c36-b854-522102a25e5e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:32.661854 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bf451fbe-8357-4c36-b854-522102a25e5e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:32.662316 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bf451fbe-8357-4c36-b854-522102a25e5e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:32.799560 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bf451fbe-8357-4c36-b854-522102a25e5e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561734cf36e47b5ab2d7242076437ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2843a54fec340e19485e7b821fc071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:32.807208 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bf451fbe-8357-4c36-b854-522102a25e5e tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 200 len: 1674 microversion: 2.1 time: 0.159058 Jul 21 06:37:32.807776 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 518/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:32 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:37:32.812973 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-45b63947-0a0a-4b3f-9397-d0e1f5467e5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:32.813889 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-45b63947-0a0a-4b3f-9397-d0e1f5467e5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:32.820021 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-45b63947-0a0a-4b3f-9397-d0e1f5467e5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:32.820548 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-45b63947-0a0a-4b3f-9397-d0e1f5467e5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:32.821357 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-45b63947-0a0a-4b3f-9397-d0e1f5467e5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:32.821795 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-45b63947-0a0a-4b3f-9397-d0e1f5467e5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:32.963136 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-45b63947-0a0a-4b3f-9397-d0e1f5467e5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:32.970683 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-45b63947-0a0a-4b3f-9397-d0e1f5467e5d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.161698 Jul 21 06:37:32.971255 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 519/1032] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:32 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:33.145683 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-60af4da2-9af3-43c9-8f30-e4c53720f9d1 req-00ac2dfb-b133-4219-82bf-76d611b337eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efabe894-210e-4604-a672-71967b164f19", "name": "network-vif-deleted", "tag": "1f2280ad-29cb-4bee-9cdc-eda920400b0c"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:33.154711 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-60af4da2-9af3-43c9-8f30-e4c53720f9d1 req-00ac2dfb-b133-4219-82bf-76d611b337eb service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:33.156200 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-60af4da2-9af3-43c9-8f30-e4c53720f9d1 req-00ac2dfb-b133-4219-82bf-76d611b337eb service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:33.169533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-60af4da2-9af3-43c9-8f30-e4c53720f9d1 req-00ac2dfb-b133-4219-82bf-76d611b337eb service nova] Creating event network-vif-deleted:1f2280ad-29cb-4bee-9cdc-eda920400b0c for instance efabe894-210e-4604-a672-71967b164f19 on hv-cinder-85031 Jul 21 06:37:33.175714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-60af4da2-9af3-43c9-8f30-e4c53720f9d1 req-00ac2dfb-b133-4219-82bf-76d611b337eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033239 Jul 21 06:37:33.176176 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 520/1033] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:33.306964 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2c0b0468-1619-435c-b89f-b40fd96f138a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "POST /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860844 Jul 21 06:37:33.308023 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 514/1034] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:37:32 2022] POST /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:33.825633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9f85bba3-c765-4c1f-9c4c-9d85bf609eaa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:33.826383 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9f85bba3-c765-4c1f-9c4c-9d85bf609eaa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:33.833231 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9f85bba3-c765-4c1f-9c4c-9d85bf609eaa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:33.833690 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9f85bba3-c765-4c1f-9c4c-9d85bf609eaa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:33.834501 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9f85bba3-c765-4c1f-9c4c-9d85bf609eaa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:33.834946 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9f85bba3-c765-4c1f-9c4c-9d85bf609eaa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:33.848444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-9f85bba3-c765-4c1f-9c4c-9d85bf609eaa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] HTTP exception thrown: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9f85bba3-c765-4c1f-9c4c-9d85bf609eaa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Request method failure captured: Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 HTTP/1.1 Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKCcqaJBeB54FqXGaKKur-nfreQlHLohIqNdAugUhSQWq-xZokTWqQyBAuFpjKLZATcAoXRZvXdX24tAeEE1pIqTT7udK3AGpgcs4K7otiLAHxAAC5VH6BryWRz4yGA0UbhT4ure-BanWjUXr-WbBethAmMBV2bggPJ90DadrEzVh0 Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:37:33.850128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2843a54fec340e19485e7b821fc071a"}]}] Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 8561734cf36e47b5ab2d7242076437ff Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:33.851687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'efabe894-210e-4604-a672-71967b164f19'} Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:33.852608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:33.854272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:33.855754 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9f85bba3-c765-4c1f-9c4c-9d85bf609eaa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Returning 404 to user: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:33.855754 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9f85bba3-c765-4c1f-9c4c-9d85bf609eaa tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 404 len: 111 microversion: 2.1 time: 0.030660 Jul 21 06:37:33.855754 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 521/1035] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:33 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:33.861900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5c631942-ec3e-4d38-ac42-2b8c09ec3e0c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '.version_select at 0x7f9327ba3040>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:33.880201 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5c631942-ec3e-4d38-ac42-2b8c09ec3e0c tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649535709" status: 202 len: 0 microversion: 2.1 time: 0.023372 Jul 21 06:37:33.881017 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 515/1036] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jul 21 06:37:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649535709 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:37:33.988705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-72a650ef-8ad6-415e-9070-a760347279de tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:33.989420 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-72a650ef-8ad6-415e-9070-a760347279de tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:33.995729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-72a650ef-8ad6-415e-9070-a760347279de tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:33.996178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-72a650ef-8ad6-415e-9070-a760347279de tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:33.996949 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-72a650ef-8ad6-415e-9070-a760347279de tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:33.997384 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-72a650ef-8ad6-415e-9070-a760347279de tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:34.163871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-72a650ef-8ad6-415e-9070-a760347279de tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:34.173148 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-72a650ef-8ad6-415e-9070-a760347279de tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.189395 Jul 21 06:37:34.181293 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 522/1037] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:33 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:35.190570 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-efd3f575-b9bc-4f06-ab19-45d7f0b51917 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:35.191374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-efd3f575-b9bc-4f06-ab19-45d7f0b51917 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:35.198157 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-efd3f575-b9bc-4f06-ab19-45d7f0b51917 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:35.198606 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-efd3f575-b9bc-4f06-ab19-45d7f0b51917 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:35.199390 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-efd3f575-b9bc-4f06-ab19-45d7f0b51917 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:35.199825 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-efd3f575-b9bc-4f06-ab19-45d7f0b51917 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:35.330876 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-efd3f575-b9bc-4f06-ab19-45d7f0b51917 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:35.338347 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-efd3f575-b9bc-4f06-ab19-45d7f0b51917 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.152311 Jul 21 06:37:35.338914 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 516/1038] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:35 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:36.354984 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f561880b-f4d4-4302-95cc-885983e0ae37 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:36.355546 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f561880b-f4d4-4302-95cc-885983e0ae37 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:36.362559 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f561880b-f4d4-4302-95cc-885983e0ae37 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:36.363012 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f561880b-f4d4-4302-95cc-885983e0ae37 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:36.363780 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f561880b-f4d4-4302-95cc-885983e0ae37 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:36.364219 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f561880b-f4d4-4302-95cc-885983e0ae37 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:36.366917 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:37:36.494154 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f561880b-f4d4-4302-95cc-885983e0ae37 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:36.501871 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f561880b-f4d4-4302-95cc-885983e0ae37 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.150809 Jul 21 06:37:36.502466 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 523/1039] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:36 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:36.818762 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-071f6745-6aa1-4c24-a7ef-ad4671023f9a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:36.819381 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-071f6745-6aa1-4c24-a7ef-ad4671023f9a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:36.825902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-071f6745-6aa1-4c24-a7ef-ad4671023f9a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:36.826384 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-071f6745-6aa1-4c24-a7ef-ad4671023f9a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:36.827189 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-071f6745-6aa1-4c24-a7ef-ad4671023f9a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:36.827623 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-071f6745-6aa1-4c24-a7ef-ad4671023f9a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:36.840799 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-071f6745-6aa1-4c24-a7ef-ad4671023f9a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] HTTP exception thrown: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-071f6745-6aa1-4c24-a7ef-ad4671023f9a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Request method failure captured: Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: DELETE /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 HTTP/1.1 Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKCcqaJBeB54FqXGaKKur-nfreQlHLohIqNdAugUhSQWq-xZokTWqQyBAuFpjKLZATcAoXRZvXdX24tAeEE1pIqTT7udK3AGpgcs4K7otiLAHxAAC5VH6BryWRz4yGA0UbhT4ure-BanWjUXr-WbBethAmMBV2bggPJ90DadrEzVh0 Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:37:36.842478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2843a54fec340e19485e7b821fc071a"}]}] Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 8561734cf36e47b5ab2d7242076437ff Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:36.844563 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': 'efabe894-210e-4604-a672-71967b164f19'} Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:36.845505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:36.846998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:36.848478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-071f6745-6aa1-4c24-a7ef-ad4671023f9a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Returning 404 to user: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:36.848478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-071f6745-6aa1-4c24-a7ef-ad4671023f9a tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "DELETE /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 404 len: 111 microversion: 2.1 time: 0.029464 Jul 21 06:37:36.848478 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 517/1040] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:37:36 2022] DELETE /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:36.853401 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f9876ca8-4343-44bc-a795-a0429d6227c5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:36.854047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f9876ca8-4343-44bc-a795-a0429d6227c5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: efabe894-210e-4604-a672-71967b164f19] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:36.861143 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f9876ca8-4343-44bc-a795-a0429d6227c5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:36.861589 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f9876ca8-4343-44bc-a795-a0429d6227c5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:36.862379 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f9876ca8-4343-44bc-a795-a0429d6227c5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:36.862815 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f9876ca8-4343-44bc-a795-a0429d6227c5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:36.876080 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-f9876ca8-4343-44bc-a795-a0429d6227c5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] HTTP exception thrown: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f9876ca8-4343-44bc-a795-a0429d6227c5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Request method failure captured: Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 HTTP/1.1 Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKCcqaJBeB54FqXGaKKur-nfreQlHLohIqNdAugUhSQWq-xZokTWqQyBAuFpjKLZATcAoXRZvXdX24tAeEE1pIqTT7udK3AGpgcs4K7otiLAHxAAC5VH6BryWRz4yGA0UbhT4ure-BanWjUXr-WbBethAmMBV2bggPJ90DadrEzVh0 Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:37:36.877587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2843a54fec340e19485e7b821fc071a"}]}] Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 8561734cf36e47b5ab2d7242076437ff Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:36.879187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'efabe894-210e-4604-a672-71967b164f19'} Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:36.880178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. Jul 21 06:37:36.881649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:36.883299 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f9876ca8-4343-44bc-a795-a0429d6227c5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Returning 404 to user: Instance efabe894-210e-4604-a672-71967b164f19 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:36.883299 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f9876ca8-4343-44bc-a795-a0429d6227c5 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19" status: 404 len: 111 microversion: 2.1 time: 0.029501 Jul 21 06:37:36.883299 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 524/1041] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:36 2022] GET /compute/v2.1/servers/efabe894-210e-4604-a672-71967b164f19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:37.519183 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-3426d44a-9180-4f9b-9704-dc5d7f125552 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:37.520257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-3426d44a-9180-4f9b-9704-dc5d7f125552 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:37.526573 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3426d44a-9180-4f9b-9704-dc5d7f125552 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:37.527023 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3426d44a-9180-4f9b-9704-dc5d7f125552 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:37.527865 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3426d44a-9180-4f9b-9704-dc5d7f125552 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:37.528681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-3426d44a-9180-4f9b-9704-dc5d7f125552 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:37.653889 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-7f30919f-6dff-40fb-9b08-f448875c633a req-c0d3afad-e54c-4cac-8c4a-39194f700002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4bc012-5129-4651-97ea-340f735e5e53", "name": "network-vif-plugged", "status": "completed", "tag": "a91746a4-9dc2-4a55-966c-ce5ac2be362d"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:37.665888 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-7f30919f-6dff-40fb-9b08-f448875c633a req-c0d3afad-e54c-4cac-8c4a-39194f700002 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:37.666577 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-7f30919f-6dff-40fb-9b08-f448875c633a req-c0d3afad-e54c-4cac-8c4a-39194f700002 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:37.679506 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-7f30919f-6dff-40fb-9b08-f448875c633a req-c0d3afad-e54c-4cac-8c4a-39194f700002 service nova] Creating event network-vif-plugged:a91746a4-9dc2-4a55-966c-ce5ac2be362d for instance 1d4bc012-5129-4651-97ea-340f735e5e53 on hv-cinder-85031 Jul 21 06:37:37.680214 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-3426d44a-9180-4f9b-9704-dc5d7f125552 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:37.684972 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-7f30919f-6dff-40fb-9b08-f448875c633a req-c0d3afad-e54c-4cac-8c4a-39194f700002 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035578 Jul 21 06:37:37.688040 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 525/1042] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:37:37.690533 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-3426d44a-9180-4f9b-9704-dc5d7f125552 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.176219 Jul 21 06:37:37.691182 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 518/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:37 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:38.018049 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-150aa971-df9d-49e7-9cb2-c1eff6cdc3ce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:38.018668 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-150aa971-df9d-49e7-9cb2-c1eff6cdc3ce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:38.025273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-150aa971-df9d-49e7-9cb2-c1eff6cdc3ce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:38.025859 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-150aa971-df9d-49e7-9cb2-c1eff6cdc3ce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:38.027003 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-150aa971-df9d-49e7-9cb2-c1eff6cdc3ce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:38.027440 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-150aa971-df9d-49e7-9cb2-c1eff6cdc3ce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:38.042532 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-150aa971-df9d-49e7-9cb2-c1eff6cdc3ce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] HTTP exception thrown: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-150aa971-df9d-49e7-9cb2-c1eff6cdc3ce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Request method failure captured: Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 HTTP/1.1 Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKCcqaJBeB54FqXGaKKur-nfreQlHLohIqNdAugUhSQWq-xZokTWqQyBAuFpjKLZATcAoXRZvXdX24tAeEE1pIqTT7udK3AGpgcs4K7otiLAHxAAC5VH6BryWRz4yGA0UbhT4ure-BanWjUXr-WbBethAmMBV2bggPJ90DadrEzVh0 Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:37:38.044392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2843a54fec340e19485e7b821fc071a"}]}] Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 8561734cf36e47b5ab2d7242076437ff Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:37:38.046289 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'e7788e87-32b8-4250-bae6-b666d958ab97'} Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:38.047305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:37:38.051696 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:38.053173 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-150aa971-df9d-49e7-9cb2-c1eff6cdc3ce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Returning 404 to user: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:38.053173 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-150aa971-df9d-49e7-9cb2-c1eff6cdc3ce tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 404 len: 111 microversion: 2.1 time: 0.034850 Jul 21 06:37:38.053173 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 526/1044] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:37:38 2022] DELETE /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:38.058366 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d22bcc15-f786-4bdf-ba94-9ca3c4f83ed2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:38.059093 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d22bcc15-f786-4bdf-ba94-9ca3c4f83ed2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] [instance: e7788e87-32b8-4250-bae6-b666d958ab97] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:38.066696 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d22bcc15-f786-4bdf-ba94-9ca3c4f83ed2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:38.067229 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d22bcc15-f786-4bdf-ba94-9ca3c4f83ed2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:38.068081 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d22bcc15-f786-4bdf-ba94-9ca3c4f83ed2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:38.068735 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d22bcc15-f786-4bdf-ba94-9ca3c4f83ed2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:38.083019 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-d22bcc15-f786-4bdf-ba94-9ca3c4f83ed2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] HTTP exception thrown: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d22bcc15-f786-4bdf-ba94-9ca3c4f83ed2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Request method failure captured: Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 HTTP/1.1 Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKCcqaJBeB54FqXGaKKur-nfreQlHLohIqNdAugUhSQWq-xZokTWqQyBAuFpjKLZATcAoXRZvXdX24tAeEE1pIqTT7udK3AGpgcs4K7otiLAHxAAC5VH6BryWRz4yGA0UbhT4ure-BanWjUXr-WbBethAmMBV2bggPJ90DadrEzVh0 Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:37:38.084681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2843a54fec340e19485e7b821fc071a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2843a54fec340e19485e7b821fc071a"}]}] Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: b2843a54fec340e19485e7b821fc071a Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127861397 Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 8561734cf36e47b5ab2d7242076437ff Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeTestJSON-127861397-project Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:37:38.086391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': 'e7788e87-32b8-4250-bae6-b666d958ab97'} Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:38.087802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. Jul 21 06:37:38.090297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:38.092429 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d22bcc15-f786-4bdf-ba94-9ca3c4f83ed2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] Returning 404 to user: Instance e7788e87-32b8-4250-bae6-b666d958ab97 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:38.092429 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d22bcc15-f786-4bdf-ba94-9ca3c4f83ed2 tempest-AttachVolumeTestJSON-127861397 tempest-AttachVolumeTestJSON-127861397-project] 10.222.0.42 "GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97" status: 404 len: 111 microversion: 2.1 time: 0.031920 Jul 21 06:37:38.092429 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 519/1045] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:38 2022] GET /compute/v2.1/servers/e7788e87-32b8-4250-bae6-b666d958ab97 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:38.707029 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-22984877-c7db-4328-aebd-696048d5c227 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:38.707650 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-22984877-c7db-4328-aebd-696048d5c227 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:38.714229 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-22984877-c7db-4328-aebd-696048d5c227 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:38.714705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-22984877-c7db-4328-aebd-696048d5c227 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:38.715463 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-22984877-c7db-4328-aebd-696048d5c227 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:38.715944 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-22984877-c7db-4328-aebd-696048d5c227 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:38.920628 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-22984877-c7db-4328-aebd-696048d5c227 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:38.928173 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-22984877-c7db-4328-aebd-696048d5c227 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1259 microversion: 2.1 time: 0.225022 Jul 21 06:37:38.928745 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 527/1046] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:38 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:39.945233 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6c831317-a2b7-4fa1-8d17-c880967c711d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:39.945922 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6c831317-a2b7-4fa1-8d17-c880967c711d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:39.953453 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6c831317-a2b7-4fa1-8d17-c880967c711d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:39.953906 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6c831317-a2b7-4fa1-8d17-c880967c711d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:39.954866 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6c831317-a2b7-4fa1-8d17-c880967c711d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:39.955313 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6c831317-a2b7-4fa1-8d17-c880967c711d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:40.156820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6c831317-a2b7-4fa1-8d17-c880967c711d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:40.170879 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6c831317-a2b7-4fa1-8d17-c880967c711d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1442 microversion: 2.1 time: 0.230019 Jul 21 06:37:40.172524 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 520/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:39 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1442 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:40.197509 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-98b79b99-a2b7-4b7d-875b-94cc30f3c3b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:40.198205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-98b79b99-a2b7-4b7d-875b-94cc30f3c3b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:40.214207 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-98b79b99-a2b7-4b7d-875b-94cc30f3c3b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:40.215960 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-98b79b99-a2b7-4b7d-875b-94cc30f3c3b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:40.216810 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-98b79b99-a2b7-4b7d-875b-94cc30f3c3b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:40.217265 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-98b79b99-a2b7-4b7d-875b-94cc30f3c3b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:40.687789 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-98b79b99-a2b7-4b7d-875b-94cc30f3c3b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:40.695585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-98b79b99-a2b7-4b7d-875b-94cc30f3c3b7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1442 microversion: 2.1 time: 0.509892 Jul 21 06:37:40.696154 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 528/1048] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:40 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1442 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:40.991511 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9a9c7c92-4569-4fef-9a52-ff58cf499a75 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:40.992835 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9a9c7c92-4569-4fef-9a52-ff58cf499a75 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:41.000184 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a9c7c92-4569-4fef-9a52-ff58cf499a75 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:41.000517 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a9c7c92-4569-4fef-9a52-ff58cf499a75 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:41.001473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a9c7c92-4569-4fef-9a52-ff58cf499a75 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:41.002491 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9a9c7c92-4569-4fef-9a52-ff58cf499a75 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:41.114571 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-9a9c7c92-4569-4fef-9a52-ff58cf499a75 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lazy-loading 'services' on Instance uuid 06d03e98-dac8-461e-8cbe-8ae960c87228 {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:37:41.226163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9a9c7c92-4569-4fef-9a52-ff58cf499a75 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/os-volume_attachments/25d72b42-409a-4b43-808c-415b01105651" status: 202 len: 0 microversion: 2.1 time: 0.238463 Jul 21 06:37:41.227835 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 521/1049] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:37:40 2022] DELETE /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/os-volume_attachments/25d72b42-409a-4b43-808c-415b01105651 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:37:41.242781 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d25d7383-115e-450f-a670-c2d5cc0c2179 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:41.247783 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d25d7383-115e-450f-a670-c2d5cc0c2179 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:41.269262 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d25d7383-115e-450f-a670-c2d5cc0c2179 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:41.269785 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d25d7383-115e-450f-a670-c2d5cc0c2179 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:41.270843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d25d7383-115e-450f-a670-c2d5cc0c2179 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:41.271461 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d25d7383-115e-450f-a670-c2d5cc0c2179 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:41.344503 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d25d7383-115e-450f-a670-c2d5cc0c2179 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106146 Jul 21 06:37:41.348643 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 529/1050] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:37:41 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:42.355670 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b1df89bd-de1c-435e-a94b-f34b25a6e324 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:42.357314 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b1df89bd-de1c-435e-a94b-f34b25a6e324 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:42.364879 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1df89bd-de1c-435e-a94b-f34b25a6e324 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:42.365333 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1df89bd-de1c-435e-a94b-f34b25a6e324 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:42.366365 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1df89bd-de1c-435e-a94b-f34b25a6e324 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:42.366797 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1df89bd-de1c-435e-a94b-f34b25a6e324 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:42.403062 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b1df89bd-de1c-435e-a94b-f34b25a6e324 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051605 Jul 21 06:37:42.403947 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 522/1051] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:37:42 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:37:42.466326 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d072ee1a-b327-4fc4-bf9d-7c9e2a1162b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:42.466858 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d072ee1a-b327-4fc4-bf9d-7c9e2a1162b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:42.474557 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d072ee1a-b327-4fc4-bf9d-7c9e2a1162b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:42.475248 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d072ee1a-b327-4fc4-bf9d-7c9e2a1162b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:42.476019 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d072ee1a-b327-4fc4-bf9d-7c9e2a1162b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:42.476508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d072ee1a-b327-4fc4-bf9d-7c9e2a1162b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:42.502348 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d072ee1a-b327-4fc4-bf9d-7c9e2a1162b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:37:42.587529 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d072ee1a-b327-4fc4-bf9d-7c9e2a1162b6 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 204 len: 0 microversion: 2.1 time: 0.124936 Jul 21 06:37:42.588128 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 530/1052] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:37:42 2022] DELETE /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 06:37:42.597414 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7fb747d3-1efb-45ac-b74d-b9ea11ab8e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:42.598612 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7fb747d3-1efb-45ac-b74d-b9ea11ab8e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:42.604951 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7fb747d3-1efb-45ac-b74d-b9ea11ab8e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:42.605680 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7fb747d3-1efb-45ac-b74d-b9ea11ab8e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:42.606492 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7fb747d3-1efb-45ac-b74d-b9ea11ab8e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:42.606937 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7fb747d3-1efb-45ac-b74d-b9ea11ab8e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:42.739500 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-c2729047-39c3-4c90-8984-2e7c927a582c req-6885529a-08fd-4e45-9b33-2ae05e514e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d4bc012-5129-4651-97ea-340f735e5e53", "tag": "a91746a4-9dc2-4a55-966c-ce5ac2be362d"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:42.751466 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-c2729047-39c3-4c90-8984-2e7c927a582c req-6885529a-08fd-4e45-9b33-2ae05e514e9c service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:42.752197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-c2729047-39c3-4c90-8984-2e7c927a582c req-6885529a-08fd-4e45-9b33-2ae05e514e9c service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:42.766465 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-c2729047-39c3-4c90-8984-2e7c927a582c req-6885529a-08fd-4e45-9b33-2ae05e514e9c service nova] Creating event network-changed:a91746a4-9dc2-4a55-966c-ce5ac2be362d for instance 1d4bc012-5129-4651-97ea-340f735e5e53 on hv-cinder-85031 Jul 21 06:37:42.767997 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7fb747d3-1efb-45ac-b74d-b9ea11ab8e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:42.772187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-c2729047-39c3-4c90-8984-2e7c927a582c req-6885529a-08fd-4e45-9b33-2ae05e514e9c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037453 Jul 21 06:37:42.773431 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 531/1053] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:42.778056 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7fb747d3-1efb-45ac-b74d-b9ea11ab8e50 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1683 microversion: 2.1 time: 0.185453 Jul 21 06:37:42.778671 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 523/1054] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:42 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:43.164907 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ec01c357-8319-4e74-af05-931554079383 tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] Action: 'create', calling method: .version_select at 0x7f9327b218b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-720659923", "metadata": {"Type": "work"}}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:43.465217 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ec01c357-8319-4e74-af05-931554079383 tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.421006 Jul 21 06:37:43.465851 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 532/1055] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jul 21 06:37:43 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 423 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 06:37:43.478518 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-25c5d398-13da-413a-aed9-baedb6f15860 tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] Calling method '.version_select at 0x7f93383c95e0>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:43.539786 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-25c5d398-13da-413a-aed9-baedb6f15860 tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922" status: 200 len: 352 microversion: 2.1 time: 0.065645 Jul 21 06:37:43.540482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 524/1056] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:37:43 2022] GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:43.794987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8d6eb26d-f064-4e59-b8a8-1e5d5932b31e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:43.795752 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8d6eb26d-f064-4e59-b8a8-1e5d5932b31e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:43.803741 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d6eb26d-f064-4e59-b8a8-1e5d5932b31e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:43.804243 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d6eb26d-f064-4e59-b8a8-1e5d5932b31e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:43.805023 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d6eb26d-f064-4e59-b8a8-1e5d5932b31e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:43.805460 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d6eb26d-f064-4e59-b8a8-1e5d5932b31e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:43.940763 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8d6eb26d-f064-4e59-b8a8-1e5d5932b31e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:43.948273 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8d6eb26d-f064-4e59-b8a8-1e5d5932b31e tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1683 microversion: 2.1 time: 0.157216 Jul 21 06:37:43.948845 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 533/1057] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:43 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:44.553675 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6d36bf9f-d978-447b-b62e-97d59e518aad tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] Calling method '.version_select at 0x7f9327ca84c0>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:44.611096 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6d36bf9f-d978-447b-b62e-97d59e518aad tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922" status: 200 len: 353 microversion: 2.1 time: 0.061651 Jul 21 06:37:44.611881 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 525/1058] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:37:44 2022] GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:44.623496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-df73da83-b6c4-4803-9b71-e0b600e3f544 tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] Calling method '.version_select at 0x7f9327b60d30>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:44.679519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-df73da83-b6c4-4803-9b71-e0b600e3f544 tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922" status: 200 len: 353 microversion: 2.1 time: 0.060354 Jul 21 06:37:44.680255 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 534/1059] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:37:44 2022] GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:44.704855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9fd48015-d18b-47e8-bf34-fe9020bb4ffb tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] Calling method '.version_select at 0x7f9327ba30d0>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:44.776963 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9fd48015-d18b-47e8-bf34-fe9020bb4ffb tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922" status: 202 len: 0 microversion: 2.1 time: 0.078463 Jul 21 06:37:44.777665 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 526/1060] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 06:37:44 2022] DELETE /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:37:44.786950 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b7595b52-32df-415a-88d0-775bd5899147 tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] Calling method '.version_select at 0x7f9327bb13a0>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:44.844885 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b7595b52-32df-415a-88d0-775bd5899147 tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922" status: 200 len: 352 microversion: 2.1 time: 0.062186 Jul 21 06:37:44.845474 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 535/1061] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:37:44 2022] GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:44.966230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-883ad609-0149-4aa9-be6f-940bf353207d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:44.966853 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-883ad609-0149-4aa9-be6f-940bf353207d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:44.973080 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-883ad609-0149-4aa9-be6f-940bf353207d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:44.973550 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-883ad609-0149-4aa9-be6f-940bf353207d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:44.974354 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-883ad609-0149-4aa9-be6f-940bf353207d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:44.974892 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-883ad609-0149-4aa9-be6f-940bf353207d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:45.068625 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-883ad609-0149-4aa9-be6f-940bf353207d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c54ac39faa84c7db5b9b63360216d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4bcbfdd4a42e5a542dbf019166beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:37:45.078999 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-883ad609-0149-4aa9-be6f-940bf353207d tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 200 len: 1615 microversion: 2.1 time: 0.116456 Jul 21 06:37:45.079963 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 527/1062] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:44 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 1615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:37:45.338794 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-332b0334-0278-42a7-83f6-bf4923ae353b req-9b121ecd-4bf4-41c3-9415-82911e81a359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d03e98-dac8-461e-8cbe-8ae960c87228", "name": "network-vif-deleted", "tag": "612a5fc7-7a9f-44fe-9ef7-1df871aa95f6"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:45.350444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-332b0334-0278-42a7-83f6-bf4923ae353b req-9b121ecd-4bf4-41c3-9415-82911e81a359 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:45.350896 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-332b0334-0278-42a7-83f6-bf4923ae353b req-9b121ecd-4bf4-41c3-9415-82911e81a359 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:45.363648 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-332b0334-0278-42a7-83f6-bf4923ae353b req-9b121ecd-4bf4-41c3-9415-82911e81a359 service nova] Creating event network-vif-deleted:612a5fc7-7a9f-44fe-9ef7-1df871aa95f6 for instance 06d03e98-dac8-461e-8cbe-8ae960c87228 on hv-cinder-85031 Jul 21 06:37:45.370381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-332b0334-0278-42a7-83f6-bf4923ae353b req-9b121ecd-4bf4-41c3-9415-82911e81a359 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035149 Jul 21 06:37:45.371207 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 536/1063] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:45.856447 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-01ce7f03-af67-4d42-a727-dd168c4f1dab tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] Calling method '.version_select at 0x7f9327ba3a60>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:45.886364 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-01ce7f03-af67-4d42-a727-dd168c4f1dab tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] HTTP exception thrown: Volume 11e667f6-cf23-453a-9768-92707e819922 could not be found. Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-01ce7f03-af67-4d42-a727-dd168c4f1dab tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] Request method failure captured: Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922 HTTP/1.1 Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PQ2kgzSoApsB5G9jkbpZhhzeiuu7j639gdhVYw5CHwmaUXXBnUn18KtE648AleGVDm4vadk3mQ3-Se7FrUgQoo_CDMvAhviSYK7OHEU0gfI9k8eBQgXEEUfPFblIMLVSsZCNpY26okl3rrOUhXYm9evrR29Yc6DKdadYvemnes240Q Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: e927311b947c48629d1ebd6c29ba7d50 Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-VolumesGetTestJSON-1940644473 Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:37:45.889723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e927311b947c48629d1ebd6c29ba7d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e927311b947c48629d1ebd6c29ba7d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e927311b947c48629d1ebd6c29ba7d50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e927311b947c48629d1ebd6c29ba7d50"}]}] Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-VolumesGetTestJSON-1940644473 Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: e927311b947c48629d1ebd6c29ba7d50 Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-VolumesGetTestJSON-1940644473 Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-VolumesGetTestJSON-1940644473-project Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: d4e425d00b4a4f1b9043c91d23ed9331 Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-VolumesGetTestJSON-1940644473-project Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Volume 11e667f6-cf23-453a-9768-92707e819922 could not be found. Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '11e667f6-cf23-453a-9768-92707e819922'} Jul 21 06:37:45.891581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11e667f6-cf23-453a-9768-92707e819922 could not be found. (HTTP 404) (Request-ID: req-bab5fc09-94c6-45c1-8f78-f36f576dccda) Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:45.892609 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 06:37:45.895090 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11e667f6-cf23-453a-9768-92707e819922 could not be found. Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 06:37:45.896837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11e667f6-cf23-453a-9768-92707e819922 could not be found. Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11e667f6-cf23-453a-9768-92707e819922 could not be found. Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-01ce7f03-af67-4d42-a727-dd168c4f1dab tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] Returning 404 to user: Volume 11e667f6-cf23-453a-9768-92707e819922 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-01ce7f03-af67-4d42-a727-dd168c4f1dab tempest-VolumesGetTestJSON-1940644473 tempest-VolumesGetTestJSON-1940644473-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922" status: 404 len: 109 microversion: 2.1 time: 0.038703 Jul 21 06:37:45.899912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 528/1064] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:37:45 2022] GET /compute/v2.1/os-volumes/11e667f6-cf23-453a-9768-92707e819922 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:46.098429 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-beeac96a-be21-42b7-8dfa-5bbccebdc059 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:46.099156 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-beeac96a-be21-42b7-8dfa-5bbccebdc059 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:46.106161 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-beeac96a-be21-42b7-8dfa-5bbccebdc059 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:46.106848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-beeac96a-be21-42b7-8dfa-5bbccebdc059 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:46.107636 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-beeac96a-be21-42b7-8dfa-5bbccebdc059 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:46.108066 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-beeac96a-be21-42b7-8dfa-5bbccebdc059 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:46.122882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-beeac96a-be21-42b7-8dfa-5bbccebdc059 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-beeac96a-be21-42b7-8dfa-5bbccebdc059 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 HTTP/1.1 Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:37:46.124880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:46.126543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '06d03e98-dac8-461e-8cbe-8ae960c87228'} Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:46.129107 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:46.132016 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:46.133726 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-beeac96a-be21-42b7-8dfa-5bbccebdc059 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:46.133726 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-beeac96a-be21-42b7-8dfa-5bbccebdc059 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 404 len: 111 microversion: 2.1 time: 0.032345 Jul 21 06:37:46.133726 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 537/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:46 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:46.137839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8e0bb5a2-023d-4972-8dfb-2140d639e89a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '.version_select at 0x7f9338239a60>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:46.161824 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8e0bb5a2-023d-4972-8dfb-2140d639e89a tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-865693186" status: 202 len: 0 microversion: 2.1 time: 0.029484 Jul 21 06:37:46.163282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 529/1066] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jul 21 06:37:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-865693186 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:37:48.048070 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0f9795d7-fd87-4976-b4e3-e117820d06b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:48.048600 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0f9795d7-fd87-4976-b4e3-e117820d06b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:48.055035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0f9795d7-fd87-4976-b4e3-e117820d06b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:48.055763 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0f9795d7-fd87-4976-b4e3-e117820d06b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:48.056697 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0f9795d7-fd87-4976-b4e3-e117820d06b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:48.057240 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0f9795d7-fd87-4976-b4e3-e117820d06b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:48.071533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-0f9795d7-fd87-4976-b4e3-e117820d06b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0f9795d7-fd87-4976-b4e3-e117820d06b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 HTTP/1.1 Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:37:48.073072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:48.074724 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '06d03e98-dac8-461e-8cbe-8ae960c87228'} Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:48.079528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:48.080769 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:48.082000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0f9795d7-fd87-4976-b4e3-e117820d06b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:48.082000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0f9795d7-fd87-4976-b4e3-e117820d06b2 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 404 len: 111 microversion: 2.1 time: 0.030530 Jul 21 06:37:48.082000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 538/1067] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:37:48 2022] DELETE /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:48.088040 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-15524d6b-9c2d-4a80-a566-c68d9d2a8405 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:48.088668 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-15524d6b-9c2d-4a80-a566-c68d9d2a8405 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 06d03e98-dac8-461e-8cbe-8ae960c87228] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:48.095209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-15524d6b-9c2d-4a80-a566-c68d9d2a8405 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:48.095668 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-15524d6b-9c2d-4a80-a566-c68d9d2a8405 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:48.096457 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-15524d6b-9c2d-4a80-a566-c68d9d2a8405 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:48.096901 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-15524d6b-9c2d-4a80-a566-c68d9d2a8405 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:48.111503 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-15524d6b-9c2d-4a80-a566-c68d9d2a8405 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-15524d6b-9c2d-4a80-a566-c68d9d2a8405 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 HTTP/1.1 Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:37:48.113072 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:48.114489 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '06d03e98-dac8-461e-8cbe-8ae960c87228'} Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:48.115408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. Jul 21 06:37:48.117292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:48.118530 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-15524d6b-9c2d-4a80-a566-c68d9d2a8405 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance 06d03e98-dac8-461e-8cbe-8ae960c87228 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:48.118530 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-15524d6b-9c2d-4a80-a566-c68d9d2a8405 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228" status: 404 len: 111 microversion: 2.1 time: 0.030912 Jul 21 06:37:48.118530 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 530/1068] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:48 2022] GET /compute/v2.1/servers/06d03e98-dac8-461e-8cbe-8ae960c87228 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:49.253797 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3a92d49e-e638-4205-894d-5100164bfb30 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:49.254399 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3a92d49e-e638-4205-894d-5100164bfb30 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:49.260957 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3a92d49e-e638-4205-894d-5100164bfb30 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:49.261482 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3a92d49e-e638-4205-894d-5100164bfb30 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:49.262364 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3a92d49e-e638-4205-894d-5100164bfb30 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:49.262809 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3a92d49e-e638-4205-894d-5100164bfb30 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:49.278284 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-3a92d49e-e638-4205-894d-5100164bfb30 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3a92d49e-e638-4205-894d-5100164bfb30 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 HTTP/1.1 Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:37:49.279853 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:37:49.281935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'dd58c058-dd88-4697-8b77-c6e64e146c12'} Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:49.282729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:37:49.284342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.285581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3a92d49e-e638-4205-894d-5100164bfb30 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:49.285581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3a92d49e-e638-4205-894d-5100164bfb30 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 404 len: 111 microversion: 2.1 time: 0.031985 Jul 21 06:37:49.285581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 539/1069] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:37:49 2022] DELETE /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:49.290726 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-50094e23-4d27-426d-ad47-a6d1e85feeb5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:49.291344 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-50094e23-4d27-426d-ad47-a6d1e85feeb5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: dd58c058-dd88-4697-8b77-c6e64e146c12] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:49.298566 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50094e23-4d27-426d-ad47-a6d1e85feeb5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:49.299018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50094e23-4d27-426d-ad47-a6d1e85feeb5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:49.299784 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50094e23-4d27-426d-ad47-a6d1e85feeb5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:49.300215 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50094e23-4d27-426d-ad47-a6d1e85feeb5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:49.313695 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-50094e23-4d27-426d-ad47-a6d1e85feeb5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-50094e23-4d27-426d-ad47-a6d1e85feeb5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 HTTP/1.1 Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:37:49.315257 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:37:49.317175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': 'dd58c058-dd88-4697-8b77-c6e64e146c12'} Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:49.318176 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. Jul 21 06:37:49.319718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.321042 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-50094e23-4d27-426d-ad47-a6d1e85feeb5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance dd58c058-dd88-4697-8b77-c6e64e146c12 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:49.321042 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-50094e23-4d27-426d-ad47-a6d1e85feeb5 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12" status: 404 len: 111 microversion: 2.1 time: 0.029792 Jul 21 06:37:49.321042 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 531/1070] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:49 2022] GET /compute/v2.1/servers/dd58c058-dd88-4697-8b77-c6e64e146c12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:49.326378 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4786cc40-c1df-4f0a-aa0a-c2f4bade547b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:49.326883 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4786cc40-c1df-4f0a-aa0a-c2f4bade547b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:49.333109 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4786cc40-c1df-4f0a-aa0a-c2f4bade547b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:49.333658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4786cc40-c1df-4f0a-aa0a-c2f4bade547b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:49.334554 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4786cc40-c1df-4f0a-aa0a-c2f4bade547b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:49.335038 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4786cc40-c1df-4f0a-aa0a-c2f4bade547b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:49.350055 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-4786cc40-c1df-4f0a-aa0a-c2f4bade547b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4786cc40-c1df-4f0a-aa0a-c2f4bade547b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 HTTP/1.1 Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:37:49.351631 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:37:49.353102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '3c3a3de3-c6af-4f50-b999-d47265b43595'} Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:49.353836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:37:49.355082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.356325 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4786cc40-c1df-4f0a-aa0a-c2f4bade547b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:49.356325 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4786cc40-c1df-4f0a-aa0a-c2f4bade547b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 404 len: 111 microversion: 2.1 time: 0.030492 Jul 21 06:37:49.356325 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 540/1071] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:37:49 2022] DELETE /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:49.361501 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-07dceee1-0edd-4982-865e-3ce01d29e4ba tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:49.362141 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-07dceee1-0edd-4982-865e-3ce01d29e4ba tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 3c3a3de3-c6af-4f50-b999-d47265b43595] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:49.368069 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-07dceee1-0edd-4982-865e-3ce01d29e4ba tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:49.368517 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-07dceee1-0edd-4982-865e-3ce01d29e4ba tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:49.369275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-07dceee1-0edd-4982-865e-3ce01d29e4ba tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:49.369709 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-07dceee1-0edd-4982-865e-3ce01d29e4ba tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:49.383344 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-07dceee1-0edd-4982-865e-3ce01d29e4ba tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-07dceee1-0edd-4982-865e-3ce01d29e4ba tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 HTTP/1.1 Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:37:49.385110 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:37:49.386613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '3c3a3de3-c6af-4f50-b999-d47265b43595'} Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:49.387380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. Jul 21 06:37:49.388617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:49.389718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-07dceee1-0edd-4982-865e-3ce01d29e4ba tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance 3c3a3de3-c6af-4f50-b999-d47265b43595 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:49.389718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-07dceee1-0edd-4982-865e-3ce01d29e4ba tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595" status: 404 len: 111 microversion: 2.1 time: 0.028971 Jul 21 06:37:49.389718 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 532/1072] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:49 2022] GET /compute/v2.1/servers/3c3a3de3-c6af-4f50-b999-d47265b43595 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 06:37:50.537917 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8b301916-a998-435d-8635-b33b342a2b90 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:50.538451 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8b301916-a998-435d-8635-b33b342a2b90 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:50.544554 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8b301916-a998-435d-8635-b33b342a2b90 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:50.545001 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8b301916-a998-435d-8635-b33b342a2b90 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:50.545762 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8b301916-a998-435d-8635-b33b342a2b90 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:50.546795 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8b301916-a998-435d-8635-b33b342a2b90 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:50.560828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-8b301916-a998-435d-8635-b33b342a2b90 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8b301916-a998-435d-8635-b33b342a2b90 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 HTTP/1.1 Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:37:50.563017 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:37:50.564655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '43f81355-5e49-4559-b29c-b6faefe880b7'} Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:50.568874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:37:50.571031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:37:50.573701 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8b301916-a998-435d-8635-b33b342a2b90 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:50.573701 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8b301916-a998-435d-8635-b33b342a2b90 tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 404 len: 111 microversion: 2.1 time: 0.030355 Jul 21 06:37:50.573701 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 541/1073] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:37:50 2022] DELETE /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:50.574130 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-13f1fc67-0d4e-402b-ae04-06ff1474f13b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:50.574130 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-13f1fc67-0d4e-402b-ae04-06ff1474f13b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] [instance: 43f81355-5e49-4559-b29c-b6faefe880b7] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:37:50.580451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13f1fc67-0d4e-402b-ae04-06ff1474f13b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:50.580906 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13f1fc67-0d4e-402b-ae04-06ff1474f13b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:50.581674 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13f1fc67-0d4e-402b-ae04-06ff1474f13b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:37:50.582146 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13f1fc67-0d4e-402b-ae04-06ff1474f13b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:37:50.595606 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-13f1fc67-0d4e-402b-ae04-06ff1474f13b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] HTTP exception thrown: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-13f1fc67-0d4e-402b-ae04-06ff1474f13b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Request method failure captured: Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 HTTP/1.1 Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKJB3aUSV5_7n_zXGDr_-ig13rvBQOckraO_lTZ6sQpi_KoPOukSfgchi728y87Z7jW4wA3EJp2frtWal306QwPPKdkua5tywqE-WiOxFDrqiQzu-vXZFskdwF2mv7Ftn-UWeXXC22GFGJ8hDgsmW8Skn1Iv_rUDln35P4wxqSDqBA Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:37:50.597127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1b4bcbfdd4a42e5a542dbf019166beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1b4bcbfdd4a42e5a542dbf019166beb"}]}] Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: f1b4bcbfdd4a42e5a542dbf019166beb Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102956531 Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 5c54ac39faa84c7db5b9b63360216d7b Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeNegativeTest-1102956531-project Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:37:50.598794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '43f81355-5e49-4559-b29c-b6faefe880b7'} Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:37:50.599637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. Jul 21 06:37:50.601022 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:37:50.602311 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-13f1fc67-0d4e-402b-ae04-06ff1474f13b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] Returning 404 to user: Instance 43f81355-5e49-4559-b29c-b6faefe880b7 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:37:50.602311 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-13f1fc67-0d4e-402b-ae04-06ff1474f13b tempest-AttachVolumeNegativeTest-1102956531 tempest-AttachVolumeNegativeTest-1102956531-project] 10.222.0.42 "GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7" status: 404 len: 111 microversion: 2.1 time: 0.029179 Jul 21 06:37:50.602311 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 533/1074] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:37:50 2022] GET /compute/v2.1/servers/43f81355-5e49-4559-b29c-b6faefe880b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:37:55.094168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2df8d596-d1ec-4e42-9beb-a4ffb3260f21 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Action: 'create', calling method: .version_select at 0x7f9327bb1ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-959454074"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:55.378561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2df8d596-d1ec-4e42-9beb-a4ffb3260f21 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.401404 Jul 21 06:37:55.379263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 542/1075] 10.222.0.42 () {60 vars in 1154 bytes} [Thu Jul 21 06:37:54 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 403 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 06:37:55.390032 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1293c5e0-e3ac-4105-b866-9a441861dbe2 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327bd7550>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:55.439674 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1293c5e0-e3ac-4105-b866-9a441861dbe2 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957" status: 200 len: 344 microversion: 2.1 time: 0.053102 Jul 21 06:37:55.445172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 534/1076] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:37:55 2022] GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:56.453676 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2dfee186-424e-4215-b47d-6789d9900d92 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327bffe50>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:56.501014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2dfee186-424e-4215-b47d-6789d9900d92 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957" status: 200 len: 344 microversion: 2.1 time: 0.052192 Jul 21 06:37:56.501577 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 543/1077] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:37:56 2022] GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:57.513492 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-67399d61-3751-49e0-a739-b2379c27d78b tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327c1f9d0>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:57.560308 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-67399d61-3751-49e0-a739-b2379c27d78b tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957" status: 200 len: 345 microversion: 2.1 time: 0.051033 Jul 21 06:37:57.560886 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 535/1078] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:37:57 2022] GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:57.572352 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b752ada0-23b5-4059-9690-97cb8b3cc072 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Action: 'create', calling method: .version_select at 0x7f9327b47820>, body: {"snapshot": {"volume_id": "92b849bb-5b68-4806-b14b-46235aac6957", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1685349433"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:37:57.721452 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b752ada0-23b5-4059-9690-97cb8b3cc072 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.153285 Jul 21 06:37:57.722058 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 544/1079] 10.222.0.42 () {60 vars in 1161 bytes} [Thu Jul 21 06:37:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:57.732205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ed62e3b5-a6e1-4164-a3d5-7205650edf4d tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327c829d0>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:57.764407 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ed62e3b5-a6e1-4164-a3d5-7205650edf4d tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364" status: 200 len: 287 microversion: 2.1 time: 0.036241 Jul 21 06:37:57.764952 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 536/1080] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 06:37:57 2022] GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:57.774647 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9d822f8c-3022-4ec3-a984-23be927936f2 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327a2b790>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:57.803438 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9d822f8c-3022-4ec3-a984-23be927936f2 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032540 Jul 21 06:37:57.804035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 545/1081] 10.222.0.42 () {58 vars in 1139 bytes} [Thu Jul 21 06:37:57 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:57.814298 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6fb1f8ff-5734-4c6e-92ab-3077f289fa14 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9336382af0>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:57.843776 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6fb1f8ff-5734-4c6e-92ab-3077f289fa14 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364" status: 200 len: 287 microversion: 2.1 time: 0.033655 Jul 21 06:37:57.844450 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 537/1082] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 06:37:57 2022] GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:58.855874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-494b84d8-1a55-4e0c-838e-048e3f28e4c3 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327c02d30>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:58.888880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-494b84d8-1a55-4e0c-838e-048e3f28e4c3 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364" status: 200 len: 287 microversion: 2.1 time: 0.037317 Jul 21 06:37:58.889439 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 546/1083] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 06:37:58 2022] GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:37:59.901576 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7872eaf9-ed64-40a2-b386-a246b0a1ea98 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327bfc670>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:37:59.932865 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7872eaf9-ed64-40a2-b386-a246b0a1ea98 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364" status: 200 len: 287 microversion: 2.1 time: 0.035557 Jul 21 06:37:59.933459 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 538/1084] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 06:37:59 2022] GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:38:00.942152 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:00.942925 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:00.946792 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-02f0a67c-23a3-433f-aac8-65f61914cf07 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327a2b550>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:00.977512 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-02f0a67c-23a3-433f-aac8-65f61914cf07 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364" status: 200 len: 288 microversion: 2.1 time: 0.036741 Jul 21 06:38:00.978123 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 547/1085] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 06:38:00 2022] GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:38:00.986056 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:00.986902 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:00.991741 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-102d8f9c-c2d3-4455-a755-ada604771791 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327c82820>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:01.052624 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-102d8f9c-c2d3-4455-a755-ada604771791 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364" status: 202 len: 0 microversion: 2.1 time: 0.067543 Jul 21 06:38:01.053453 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 539/1086] 10.222.0.42 () {58 vars in 1253 bytes} [Thu Jul 21 06:38:00 2022] DELETE /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:38:01.061271 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-846ab683-e2bb-46ef-8e85-d5c5e2d44a4b tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327b9d790>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:01.090751 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-846ab683-e2bb-46ef-8e85-d5c5e2d44a4b tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364" status: 200 len: 287 microversion: 2.1 time: 0.033295 Jul 21 06:38:01.091320 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 548/1087] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 06:38:01 2022] GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:38:02.102944 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-58ebe6c2-c559-402b-a95a-53f0b4ef28fc tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327bd7a60>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:02.136728 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-58ebe6c2-c559-402b-a95a-53f0b4ef28fc tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364" status: 200 len: 287 microversion: 2.1 time: 0.037997 Jul 21 06:38:02.137379 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 540/1088] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 06:38:02 2022] GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:38:03.149564 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-fcaff29e-037f-41bd-b39e-49be2cfd16cf tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327fafb80>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:03.181048 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-fcaff29e-037f-41bd-b39e-49be2cfd16cf tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364" status: 200 len: 287 microversion: 2.1 time: 0.036000 Jul 21 06:38:03.181626 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 549/1089] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 06:38:03 2022] GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:38:04.193675 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-383cfcd7-1444-4c02-88c9-7c040b1cd8f4 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327c82dc0>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:04.222830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-383cfcd7-1444-4c02-88c9-7c040b1cd8f4 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] HTTP exception thrown: Snapshot 18dbeee4-6a6d-4a79-99c5-d55c2145f364 could not be found. Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-383cfcd7-1444-4c02-88c9-7c040b1cd8f4 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Request method failure captured: Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 HTTP/1.1 Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PRCjsVs-os6LnhuvaqNhhT4TTNSlNYGroet8mXB3ihaSc-IdXgqnr_KlDgfEjpprhtu6sqiBMJPQShxHr-aEiCmwHALAbX8HVP5B6p2zU8xyuesr9nF6gEQL8B-65-GY0bWoFCtTkJtiLDkZIyFK34vcxCGL3Qce1AcCl1Uj-DHLBU Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: 5466cef7e1e842038f95082be46e9447 Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:38:04.225075 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5466cef7e1e842038f95082be46e9447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5466cef7e1e842038f95082be46e9447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5466cef7e1e842038f95082be46e9447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5466cef7e1e842038f95082be46e9447"}]}] Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: 5466cef7e1e842038f95082be46e9447 Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-VolumesSnapshotsTestJSON-420326427-project Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: f6b98dd545eb4ebb9c819f82103fae52 Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420326427-project Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Snapshot 18dbeee4-6a6d-4a79-99c5-d55c2145f364 could not be found. Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '18dbeee4-6a6d-4a79-99c5-d55c2145f364'} Jul 21 06:38:04.226765 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 18dbeee4-6a6d-4a79-99c5-d55c2145f364 could not be found. (HTTP 404) (Request-ID: req-43e0bf9d-b033-4bbc-a9c3-dcf24ffa4733) Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:04.227780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 06:38:04.229175 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 18dbeee4-6a6d-4a79-99c5-d55c2145f364 could not be found. Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 06:38:04.230925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 18dbeee4-6a6d-4a79-99c5-d55c2145f364 could not be found. Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 18dbeee4-6a6d-4a79-99c5-d55c2145f364 could not be found. Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-383cfcd7-1444-4c02-88c9-7c040b1cd8f4 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Returning 404 to user: Snapshot 18dbeee4-6a6d-4a79-99c5-d55c2145f364 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:04.232421 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-383cfcd7-1444-4c02-88c9-7c040b1cd8f4 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364" status: 404 len: 111 microversion: 2.1 time: 0.037295 Jul 21 06:38:04.233487 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 541/1090] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 06:38:04 2022] GET /compute/v2.1/os-snapshots/18dbeee4-6a6d-4a79-99c5-d55c2145f364 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:38:04.236357 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6153b648-80db-40d8-8b4f-b4e419fe0f13 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327bb19d0>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:04.297706 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6153b648-80db-40d8-8b4f-b4e419fe0f13 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957" status: 202 len: 0 microversion: 2.1 time: 0.066300 Jul 21 06:38:04.298332 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 550/1091] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 06:38:04 2022] DELETE /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:38:04.308106 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-853da39a-a507-4312-9c05-2ae3cb1002ac tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327bd7160>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:04.364141 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-853da39a-a507-4312-9c05-2ae3cb1002ac tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957" status: 200 len: 344 microversion: 2.1 time: 0.059945 Jul 21 06:38:04.364729 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 542/1092] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:38:04 2022] GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:38:05.377293 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-14c893a8-6ac0-47c2-8ab2-28682186b2e2 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327c02280>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:05.404813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-14c893a8-6ac0-47c2-8ab2-28682186b2e2 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] HTTP exception thrown: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-14c893a8-6ac0-47c2-8ab2-28682186b2e2 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Request method failure captured: Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 HTTP/1.1 Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PRCjsVs-os6LnhuvaqNhhT4TTNSlNYGroet8mXB3ihaSc-IdXgqnr_KlDgfEjpprhtu6sqiBMJPQShxHr-aEiCmwHALAbX8HVP5B6p2zU8xyuesr9nF6gEQL8B-65-GY0bWoFCtTkJtiLDkZIyFK34vcxCGL3Qce1AcCl1Uj-DHLBU Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 5466cef7e1e842038f95082be46e9447 Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:38:05.409508 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5466cef7e1e842038f95082be46e9447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5466cef7e1e842038f95082be46e9447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5466cef7e1e842038f95082be46e9447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5466cef7e1e842038f95082be46e9447"}]}] Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 5466cef7e1e842038f95082be46e9447 Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-VolumesSnapshotsTestJSON-420326427-project Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: f6b98dd545eb4ebb9c819f82103fae52 Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420326427-project Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '92b849bb-5b68-4806-b14b-46235aac6957'} Jul 21 06:38:05.411101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. (HTTP 404) (Request-ID: req-8826aa2f-af85-4c3a-8f3d-65b90f17bd54) Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:05.412053 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 06:38:05.413434 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 06:38:05.414768 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-14c893a8-6ac0-47c2-8ab2-28682186b2e2 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Returning 404 to user: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-14c893a8-6ac0-47c2-8ab2-28682186b2e2 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957" status: 404 len: 109 microversion: 2.1 time: 0.038039 Jul 21 06:38:05.416104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 551/1093] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:38:05 2022] GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:38:05.428258 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c7e0be6f-b4bb-4b18-ba0b-63dc50603220 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327bdd310>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:05.456381 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-c7e0be6f-b4bb-4b18-ba0b-63dc50603220 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] HTTP exception thrown: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c7e0be6f-b4bb-4b18-ba0b-63dc50603220 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Request method failure captured: Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: DELETE /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 HTTP/1.1 Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PRCjsVs-os6LnhuvaqNhhT4TTNSlNYGroet8mXB3ihaSc-IdXgqnr_KlDgfEjpprhtu6sqiBMJPQShxHr-aEiCmwHALAbX8HVP5B6p2zU8xyuesr9nF6gEQL8B-65-GY0bWoFCtTkJtiLDkZIyFK34vcxCGL3Qce1AcCl1Uj-DHLBU Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: 5466cef7e1e842038f95082be46e9447 Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:38:05.458451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5466cef7e1e842038f95082be46e9447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5466cef7e1e842038f95082be46e9447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5466cef7e1e842038f95082be46e9447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5466cef7e1e842038f95082be46e9447"}]}] Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: 5466cef7e1e842038f95082be46e9447 Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-VolumesSnapshotsTestJSON-420326427-project Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: f6b98dd545eb4ebb9c819f82103fae52 Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420326427-project Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '92b849bb-5b68-4806-b14b-46235aac6957'} Jul 21 06:38:05.460051 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. (HTTP 404) (Request-ID: req-3ad5724f-7efa-42cc-a379-3bd8dc737689) Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:05.461030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 06:38:05.462482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 06:38:05.463798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c7e0be6f-b4bb-4b18-ba0b-63dc50603220 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Returning 404 to user: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c7e0be6f-b4bb-4b18-ba0b-63dc50603220 tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957" status: 404 len: 109 microversion: 2.1 time: 0.036093 Jul 21 06:38:05.465209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 543/1094] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 06:38:05 2022] DELETE /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:38:05.469833 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c88ce48d-2ecb-48de-bc60-b352abd59a7d tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Calling method '.version_select at 0x7f9327f86c10>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:05.496776 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-c88ce48d-2ecb-48de-bc60-b352abd59a7d tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] HTTP exception thrown: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c88ce48d-2ecb-48de-bc60-b352abd59a7d tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Request method failure captured: Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 HTTP/1.1 Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PRCjsVs-os6LnhuvaqNhhT4TTNSlNYGroet8mXB3ihaSc-IdXgqnr_KlDgfEjpprhtu6sqiBMJPQShxHr-aEiCmwHALAbX8HVP5B6p2zU8xyuesr9nF6gEQL8B-65-GY0bWoFCtTkJtiLDkZIyFK34vcxCGL3Qce1AcCl1Uj-DHLBU Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 5466cef7e1e842038f95082be46e9447 Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:38:05.498742 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5466cef7e1e842038f95082be46e9447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5466cef7e1e842038f95082be46e9447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5466cef7e1e842038f95082be46e9447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5466cef7e1e842038f95082be46e9447"}]}] Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 5466cef7e1e842038f95082be46e9447 Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420326427 Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-VolumesSnapshotsTestJSON-420326427-project Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: f6b98dd545eb4ebb9c819f82103fae52 Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420326427-project Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '92b849bb-5b68-4806-b14b-46235aac6957'} Jul 21 06:38:05.500603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. (HTTP 404) (Request-ID: req-461ca36c-0441-4448-a468-f6c6d91b3f52) Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:05.501570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 06:38:05.502951 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 06:38:05.504235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c88ce48d-2ecb-48de-bc60-b352abd59a7d tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] Returning 404 to user: Volume 92b849bb-5b68-4806-b14b-46235aac6957 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c88ce48d-2ecb-48de-bc60-b352abd59a7d tempest-VolumesSnapshotsTestJSON-420326427 tempest-VolumesSnapshotsTestJSON-420326427-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957" status: 404 len: 109 microversion: 2.1 time: 0.034793 Jul 21 06:38:05.505608 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 552/1095] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:38:05 2022] GET /compute/v2.1/os-volumes/92b849bb-5b68-4806-b14b-46235aac6957 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:38:08.611128 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-907421100", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1128193888", "security_groups": [{"name": "tempest-secgroup-smoke-771985638"}], "block_device_mapping_v2": [{"uuid": "8ed81dcc-8a7b-45b6-8d4f-2269badde7a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dadad058-4314-4199-8e9f-a1bda80f561d"}]}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:38:08.751397 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.network.neutron [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] validate_networks() for [('dadad058-4314-4199-8e9f-a1bda80f561d', None, None, None, None, None)] {{(pid=117905) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:38:09.191621 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Flavor limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:38:09.192717 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Image limits 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:38:09.193379 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Flavor pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:38:09.194419 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Image pref 0:0:0 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:38:09.195016 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.virt.hardware [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:38:09.205013 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:09.205422 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:09.206507 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:09.206951 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:09.226407 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Getting quotas for project 5d0ba27e9a7f450c87eb189cdd6e235b. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:38:09.230577 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Getting quotas for user 5439d1a65154486bb4fdfeeaf8ab4b07 and project 5d0ba27e9a7f450c87eb189cdd6e235b. Resources: {'cores', 'ram', 'instances'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:38:09.297474 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Going to run 1 instances... {{(pid=117905) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:38:09.300112 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ed81dcc-8a7b-45b6-8d4f-2269badde7a4',volume_size=None,volume_type=None)] {{(pid=117905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:38:09.453747 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-004303a6-aecd-42de-a3b8-439aaa24a430 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.847919 Jul 21 06:38:09.455027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 544/1096] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:38:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:38:09.466051 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-272d8e58-86dc-4752-b038-85adea233269 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:09.467502 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-272d8e58-86dc-4752-b038-85adea233269 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:09.775765 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-272d8e58-86dc-4752-b038-85adea233269 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:09.791778 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-272d8e58-86dc-4752-b038-85adea233269 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1094 microversion: 2.1 time: 0.330106 Jul 21 06:38:09.793311 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 553/1097] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:09 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1094 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:10.818042 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6a6ff4fe-9b74-4489-8925-7a908aa8c8fb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:10.818664 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6a6ff4fe-9b74-4489-8925-7a908aa8c8fb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:10.832656 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a6ff4fe-9b74-4489-8925-7a908aa8c8fb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:10.833114 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a6ff4fe-9b74-4489-8925-7a908aa8c8fb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:10.834397 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a6ff4fe-9b74-4489-8925-7a908aa8c8fb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:10.834841 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6a6ff4fe-9b74-4489-8925-7a908aa8c8fb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:10.918114 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6a6ff4fe-9b74-4489-8925-7a908aa8c8fb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:10.929960 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6a6ff4fe-9b74-4489-8925-7a908aa8c8fb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1210 microversion: 2.1 time: 0.118168 Jul 21 06:38:10.940251 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 545/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:10 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:11.952472 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d30fdc69-d6b6-4318-a56b-113f0151e060 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:11.954968 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d30fdc69-d6b6-4318-a56b-113f0151e060 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:11.966322 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d30fdc69-d6b6-4318-a56b-113f0151e060 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:11.967454 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d30fdc69-d6b6-4318-a56b-113f0151e060 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:11.968496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d30fdc69-d6b6-4318-a56b-113f0151e060 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:11.970288 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d30fdc69-d6b6-4318-a56b-113f0151e060 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:12.260102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d30fdc69-d6b6-4318-a56b-113f0151e060 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:12.276840 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d30fdc69-d6b6-4318-a56b-113f0151e060 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.331312 Jul 21 06:38:12.278424 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 554/1099] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:11 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:12.532468 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1b3914b2-d8f2-4e9c-849b-6154bd34fe85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:12.534019 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1b3914b2-d8f2-4e9c-849b-6154bd34fe85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:12.541275 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1b3914b2-d8f2-4e9c-849b-6154bd34fe85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:12.541744 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1b3914b2-d8f2-4e9c-849b-6154bd34fe85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:12.542584 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1b3914b2-d8f2-4e9c-849b-6154bd34fe85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:12.543218 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1b3914b2-d8f2-4e9c-849b-6154bd34fe85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:12.589238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1b3914b2-d8f2-4e9c-849b-6154bd34fe85 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061138 Jul 21 06:38:12.595546 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 546/1100] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 06:38:12 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:12.668271 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a74da99c-f6fd-46c6-82f8-4981557a3a4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:12.669088 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a74da99c-f6fd-46c6-82f8-4981557a3a4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:12.676844 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a74da99c-f6fd-46c6-82f8-4981557a3a4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:12.677352 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a74da99c-f6fd-46c6-82f8-4981557a3a4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:12.678432 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a74da99c-f6fd-46c6-82f8-4981557a3a4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:12.678874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a74da99c-f6fd-46c6-82f8-4981557a3a4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:12.695788 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-6cb1d694-da1a-403a-8b51-6adb714af206 req-679e2d45-09e5-418d-b232-4a81c92a8882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1640afc0-f117-498d-b7aa-c8905ac22c7f", "tag": "079bd124-28ea-4a24-82cf-3ee1ee8d3689"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:38:12.711865 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-6cb1d694-da1a-403a-8b51-6adb714af206 req-679e2d45-09e5-418d-b232-4a81c92a8882 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:12.714987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a74da99c-f6fd-46c6-82f8-4981557a3a4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:38:12.715446 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-6cb1d694-da1a-403a-8b51-6adb714af206 req-679e2d45-09e5-418d-b232-4a81c92a8882 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:12.743913 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-6cb1d694-da1a-403a-8b51-6adb714af206 req-679e2d45-09e5-418d-b232-4a81c92a8882 service nova] Creating event network-changed:079bd124-28ea-4a24-82cf-3ee1ee8d3689 for instance 1640afc0-f117-498d-b7aa-c8905ac22c7f on hv-cinder-85031 Jul 21 06:38:12.751268 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-6cb1d694-da1a-403a-8b51-6adb714af206 req-679e2d45-09e5-418d-b232-4a81c92a8882 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058857 Jul 21 06:38:12.751978 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 547/1101] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:38:12.817437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a74da99c-f6fd-46c6-82f8-4981557a3a4e tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 204 len: 0 microversion: 2.20 time: 0.153722 Jul 21 06:38:12.819009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 555/1102] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jul 21 06:38:12 2022] DELETE /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 06:38:12.828577 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-bdb35b92-895f-47ca-8563-3002ea60b628 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:12.834744 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-bdb35b92-895f-47ca-8563-3002ea60b628 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:12.843454 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdb35b92-895f-47ca-8563-3002ea60b628 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:12.844114 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdb35b92-895f-47ca-8563-3002ea60b628 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:12.844988 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdb35b92-895f-47ca-8563-3002ea60b628 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:12.845503 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-bdb35b92-895f-47ca-8563-3002ea60b628 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:12.994567 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bdb35b92-895f-47ca-8563-3002ea60b628 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:13.003117 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bdb35b92-895f-47ca-8563-3002ea60b628 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:13.005554 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-bdb35b92-895f-47ca-8563-3002ea60b628 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:13.007348 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-bdb35b92-895f-47ca-8563-3002ea60b628 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.183722 Jul 21 06:38:13.008271 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 548/1103] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:12 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:38:13.295303 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1b063f06-7059-4de9-a890-597b2763dfab tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:13.296002 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1b063f06-7059-4de9-a890-597b2763dfab tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:13.303014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1b063f06-7059-4de9-a890-597b2763dfab tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:13.303462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1b063f06-7059-4de9-a890-597b2763dfab tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:13.304227 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1b063f06-7059-4de9-a890-597b2763dfab tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:13.304658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1b063f06-7059-4de9-a890-597b2763dfab tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:13.451199 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1b063f06-7059-4de9-a890-597b2763dfab tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:13.458885 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1b063f06-7059-4de9-a890-597b2763dfab tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.167723 Jul 21 06:38:13.459644 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 556/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:13 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:14.028249 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-76dbf0a9-f1bb-4bc1-ae93-b19159db9143 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:14.028991 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-76dbf0a9-f1bb-4bc1-ae93-b19159db9143 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:14.037059 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76dbf0a9-f1bb-4bc1-ae93-b19159db9143 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:14.037510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76dbf0a9-f1bb-4bc1-ae93-b19159db9143 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:14.038328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76dbf0a9-f1bb-4bc1-ae93-b19159db9143 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:14.038771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-76dbf0a9-f1bb-4bc1-ae93-b19159db9143 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:14.227955 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-76dbf0a9-f1bb-4bc1-ae93-b19159db9143 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:14.236843 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-76dbf0a9-f1bb-4bc1-ae93-b19159db9143 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:14.238515 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-76dbf0a9-f1bb-4bc1-ae93-b19159db9143 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:14.239778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-76dbf0a9-f1bb-4bc1-ae93-b19159db9143 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.216816 Jul 21 06:38:14.240361 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 549/1105] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:14 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:38:14.476778 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-589ec650-3d64-4a6b-aa90-996b4d9a3378 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:14.477391 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-589ec650-3d64-4a6b-aa90-996b4d9a3378 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:14.484416 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-589ec650-3d64-4a6b-aa90-996b4d9a3378 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:14.484867 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-589ec650-3d64-4a6b-aa90-996b4d9a3378 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:14.485656 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-589ec650-3d64-4a6b-aa90-996b4d9a3378 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:14.486196 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-589ec650-3d64-4a6b-aa90-996b4d9a3378 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:14.637614 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-589ec650-3d64-4a6b-aa90-996b4d9a3378 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:14.645909 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-589ec650-3d64-4a6b-aa90-996b4d9a3378 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.173024 Jul 21 06:38:14.646510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 557/1106] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:14 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:15.263919 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-556eb56f-5bda-41a4-bbee-a2033d75a4eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:15.265028 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-556eb56f-5bda-41a4-bbee-a2033d75a4eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:15.274999 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-556eb56f-5bda-41a4-bbee-a2033d75a4eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:15.275764 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-556eb56f-5bda-41a4-bbee-a2033d75a4eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:15.277002 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-556eb56f-5bda-41a4-bbee-a2033d75a4eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:15.278063 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-556eb56f-5bda-41a4-bbee-a2033d75a4eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:15.413430 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-556eb56f-5bda-41a4-bbee-a2033d75a4eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:15.422745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-556eb56f-5bda-41a4-bbee-a2033d75a4eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:15.424249 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-556eb56f-5bda-41a4-bbee-a2033d75a4eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:15.425409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-556eb56f-5bda-41a4-bbee-a2033d75a4eb tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.168567 Jul 21 06:38:15.425982 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 550/1107] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:15 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:38:15.663331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-cddbc4b5-7d0e-47d8-93a3-e06c44b47162 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:15.664067 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-cddbc4b5-7d0e-47d8-93a3-e06c44b47162 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:15.670581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cddbc4b5-7d0e-47d8-93a3-e06c44b47162 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:15.670968 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cddbc4b5-7d0e-47d8-93a3-e06c44b47162 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:15.672335 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cddbc4b5-7d0e-47d8-93a3-e06c44b47162 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:15.673067 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cddbc4b5-7d0e-47d8-93a3-e06c44b47162 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:15.849127 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-cddbc4b5-7d0e-47d8-93a3-e06c44b47162 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:15.856679 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-cddbc4b5-7d0e-47d8-93a3-e06c44b47162 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.197128 Jul 21 06:38:15.857263 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 558/1108] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:15 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:16.443771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0cc045d5-5f50-4306-a577-7901c0efb46d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:16.444392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0cc045d5-5f50-4306-a577-7901c0efb46d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:16.450757 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0cc045d5-5f50-4306-a577-7901c0efb46d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:16.451180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0cc045d5-5f50-4306-a577-7901c0efb46d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:16.451947 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0cc045d5-5f50-4306-a577-7901c0efb46d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:16.452392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0cc045d5-5f50-4306-a577-7901c0efb46d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:16.587358 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0cc045d5-5f50-4306-a577-7901c0efb46d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:16.596597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0cc045d5-5f50-4306-a577-7901c0efb46d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:16.598307 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0cc045d5-5f50-4306-a577-7901c0efb46d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:16.599482 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0cc045d5-5f50-4306-a577-7901c0efb46d tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.159719 Jul 21 06:38:16.600038 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 551/1109] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:16 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:38:16.873804 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ba2dbc8a-9edd-4601-97cb-e54e343c7b73 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:16.874562 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ba2dbc8a-9edd-4601-97cb-e54e343c7b73 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:16.882375 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ba2dbc8a-9edd-4601-97cb-e54e343c7b73 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:16.882826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ba2dbc8a-9edd-4601-97cb-e54e343c7b73 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:16.883588 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ba2dbc8a-9edd-4601-97cb-e54e343c7b73 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:16.884127 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ba2dbc8a-9edd-4601-97cb-e54e343c7b73 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:17.039150 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ba2dbc8a-9edd-4601-97cb-e54e343c7b73 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:17.046923 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ba2dbc8a-9edd-4601-97cb-e54e343c7b73 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.176934 Jul 21 06:38:17.056367 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 559/1110] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:16 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:17.619458 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6834275d-ade1-43de-8268-b10f818aa94a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:17.620067 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-6834275d-ade1-43de-8268-b10f818aa94a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:17.626935 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6834275d-ade1-43de-8268-b10f818aa94a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:17.627464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6834275d-ade1-43de-8268-b10f818aa94a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:17.628409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6834275d-ade1-43de-8268-b10f818aa94a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:17.629025 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-6834275d-ade1-43de-8268-b10f818aa94a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:17.861927 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6834275d-ade1-43de-8268-b10f818aa94a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:17.875423 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6834275d-ade1-43de-8268-b10f818aa94a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:17.877141 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-6834275d-ade1-43de-8268-b10f818aa94a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:17.882531 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6834275d-ade1-43de-8268-b10f818aa94a tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1724 microversion: 2.20 time: 0.263113 Jul 21 06:38:17.883142 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 552/1111] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:17 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:38:18.067848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-263dd7f7-94e2-46c6-9a15-d68ba2028e7b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:18.069460 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-263dd7f7-94e2-46c6-9a15-d68ba2028e7b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:18.077776 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-263dd7f7-94e2-46c6-9a15-d68ba2028e7b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:18.079344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-263dd7f7-94e2-46c6-9a15-d68ba2028e7b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:18.081706 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-263dd7f7-94e2-46c6-9a15-d68ba2028e7b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:18.082522 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-263dd7f7-94e2-46c6-9a15-d68ba2028e7b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:18.288708 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-263dd7f7-94e2-46c6-9a15-d68ba2028e7b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:18.297638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-263dd7f7-94e2-46c6-9a15-d68ba2028e7b tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.237390 Jul 21 06:38:18.298342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 560/1112] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:18 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:18.404562 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-44215d8d-07f4-4c75-8b3b-1d7cc485b2a2 req-9e14e4ab-5022-41fb-b735-e6811ad093ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ff60b2-b16b-481d-8396-016f9068bff1", "name": "network-vif-deleted", "tag": "4aee29c5-9551-4f05-a973-a575a8c0fa54"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:38:18.413073 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-44215d8d-07f4-4c75-8b3b-1d7cc485b2a2 req-9e14e4ab-5022-41fb-b735-e6811ad093ee service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:18.413451 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-44215d8d-07f4-4c75-8b3b-1d7cc485b2a2 req-9e14e4ab-5022-41fb-b735-e6811ad093ee service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:18.425192 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-44215d8d-07f4-4c75-8b3b-1d7cc485b2a2 req-9e14e4ab-5022-41fb-b735-e6811ad093ee service nova] Creating event network-vif-deleted:4aee29c5-9551-4f05-a973-a575a8c0fa54 for instance d6ff60b2-b16b-481d-8396-016f9068bff1 on hv-cinder-85031 Jul 21 06:38:18.430119 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-44215d8d-07f4-4c75-8b3b-1d7cc485b2a2 req-9e14e4ab-5022-41fb-b735-e6811ad093ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029462 Jul 21 06:38:18.430717 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 553/1113] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:38:18.910236 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-bfaaed88-39c5-43db-af8a-f23427599cc4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:18.910840 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-bfaaed88-39c5-43db-af8a-f23427599cc4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:18.917585 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bfaaed88-39c5-43db-af8a-f23427599cc4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:18.918072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bfaaed88-39c5-43db-af8a-f23427599cc4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:18.918857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bfaaed88-39c5-43db-af8a-f23427599cc4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:18.919285 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-bfaaed88-39c5-43db-af8a-f23427599cc4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:18.980396 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bfaaed88-39c5-43db-af8a-f23427599cc4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:18.988619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bfaaed88-39c5-43db-af8a-f23427599cc4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:18.990171 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-bfaaed88-39c5-43db-af8a-f23427599cc4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:18.991339 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-bfaaed88-39c5-43db-af8a-f23427599cc4 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1657 microversion: 2.20 time: 0.085683 Jul 21 06:38:18.991916 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 561/1114] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:18 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1657 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 06:38:19.316426 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b104e0c3-9f67-45cb-b887-95008953f323 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:19.318055 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b104e0c3-9f67-45cb-b887-95008953f323 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:19.320908 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=2 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:19.321772 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=6 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:19.328067 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b104e0c3-9f67-45cb-b887-95008953f323 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:19.328578 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b104e0c3-9f67-45cb-b887-95008953f323 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:19.329400 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b104e0c3-9f67-45cb-b887-95008953f323 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:19.329839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b104e0c3-9f67-45cb-b887-95008953f323 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:19.478601 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b104e0c3-9f67-45cb-b887-95008953f323 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:19.489729 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b104e0c3-9f67-45cb-b887-95008953f323 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.178621 Jul 21 06:38:19.493974 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 554/1115] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:19 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:20.009889 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-2c058ed8-a682-410b-a1b1-a5c4856395d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:20.010633 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-2c058ed8-a682-410b-a1b1-a5c4856395d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:20.013012 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:20.019426 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2c058ed8-a682-410b-a1b1-a5c4856395d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:20.020029 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2c058ed8-a682-410b-a1b1-a5c4856395d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:20.021019 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2c058ed8-a682-410b-a1b1-a5c4856395d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:20.021459 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-2c058ed8-a682-410b-a1b1-a5c4856395d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:20.103914 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2c058ed8-a682-410b-a1b1-a5c4856395d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:20.112367 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2c058ed8-a682-410b-a1b1-a5c4856395d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:20.114158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-2c058ed8-a682-410b-a1b1-a5c4856395d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:20.115335 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-2c058ed8-a682-410b-a1b1-a5c4856395d6 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1657 microversion: 2.20 time: 0.109396 Jul 21 06:38:20.115938 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 562/1116] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:20 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1657 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:38:20.506888 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-89b7c10a-853c-423f-9f9a-e32764625355 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:20.507508 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-89b7c10a-853c-423f-9f9a-e32764625355 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:20.514222 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-89b7c10a-853c-423f-9f9a-e32764625355 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:20.514684 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-89b7c10a-853c-423f-9f9a-e32764625355 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:20.516334 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-89b7c10a-853c-423f-9f9a-e32764625355 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:20.516808 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-89b7c10a-853c-423f-9f9a-e32764625355 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:20.659303 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-89b7c10a-853c-423f-9f9a-e32764625355 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:20.666792 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-89b7c10a-853c-423f-9f9a-e32764625355 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.163827 Jul 21 06:38:20.667504 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 555/1117] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:20 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:21.136962 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:21.136962 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:21.142780 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:21.143453 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:21.144415 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:21.144863 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:21.177677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:21.178399 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:21.179014 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lazy-loading 'fault' on Instance uuid d6ff60b2-b16b-481d-8396-016f9068bff1 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:38:21.227773 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:21.243154 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:21.244893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ec5e26839f494e98ec70ac49ebe415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be6e5aedba545f4b562423c55ddbf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:21.247153 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-41867e02-69ae-46f3-9af5-1f7167360e14 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 200 len: 1372 microversion: 2.20 time: 0.115334 Jul 21 06:38:21.248206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 563/1118] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:21 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 06:38:21.683492 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c2c38ab9-d4c8-484e-9184-92eadee51583 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:21.684049 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c2c38ab9-d4c8-484e-9184-92eadee51583 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:21.691097 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c2c38ab9-d4c8-484e-9184-92eadee51583 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:21.691544 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c2c38ab9-d4c8-484e-9184-92eadee51583 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:21.692313 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c2c38ab9-d4c8-484e-9184-92eadee51583 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:21.692751 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c2c38ab9-d4c8-484e-9184-92eadee51583 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:21.829426 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c2c38ab9-d4c8-484e-9184-92eadee51583 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:21.836900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c2c38ab9-d4c8-484e-9184-92eadee51583 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.157270 Jul 21 06:38:21.837469 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 556/1119] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:21 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:22.267971 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-18259916-1b48-46e4-a248-9b14773625c3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:22.269260 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-18259916-1b48-46e4-a248-9b14773625c3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:22.276220 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18259916-1b48-46e4-a248-9b14773625c3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:22.276681 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18259916-1b48-46e4-a248-9b14773625c3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:22.277728 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18259916-1b48-46e4-a248-9b14773625c3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:22.278206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-18259916-1b48-46e4-a248-9b14773625c3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:22.294755 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-18259916-1b48-46e4-a248-9b14773625c3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] HTTP exception thrown: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-18259916-1b48-46e4-a248-9b14773625c3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Request method failure captured: Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 HTTP/1.1 Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKLcBiTB48bwhPpmkRPF1O0ifR98sZqcVjQPZfkOMEv4bvmkZSwj78LCYfaxFbR_7GRJsNFBrxYCvmw99n3FzVA3eDgxRq2hC1xZlapH5WF_fxkxARBEoxbyFYQPSq2xXmxA2xXWg7MFo_JBQLTRiOZ1UWIpJqA-rXybEfOLADhg5U Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:38:22.296444 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2be6e5aedba545f4b562423c55ddbf80"}]}] Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 15ec5e26839f494e98ec70ac49ebe415 Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:22.298056 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'd6ff60b2-b16b-481d-8396-016f9068bff1'} Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:22.298826 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:22.300286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:22.301458 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-18259916-1b48-46e4-a248-9b14773625c3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Returning 404 to user: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:22.301458 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-18259916-1b48-46e4-a248-9b14773625c3 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 404 len: 111 microversion: 2.20 time: 0.035279 Jul 21 06:38:22.302624 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 564/1120] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:22 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 06:38:22.308562 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9a1be486-cafe-47f7-b86f-e2d29e82e345 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '.version_select at 0x7f9327c82280>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:22.330540 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9a1be486-cafe-47f7-b86f-e2d29e82e345 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681003305" status: 204 len: 0 microversion: 2.20 time: 0.026532 Jul 21 06:38:22.331253 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 557/1121] 10.222.0.42 () {60 vars in 1261 bytes} [Thu Jul 21 06:38:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681003305 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 06:38:22.854762 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6da8ea26-7838-42ec-b9cc-f65e72fcd998 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:22.856135 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6da8ea26-7838-42ec-b9cc-f65e72fcd998 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:22.862779 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6da8ea26-7838-42ec-b9cc-f65e72fcd998 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:22.863468 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6da8ea26-7838-42ec-b9cc-f65e72fcd998 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:22.864436 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6da8ea26-7838-42ec-b9cc-f65e72fcd998 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:22.865210 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6da8ea26-7838-42ec-b9cc-f65e72fcd998 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:23.086396 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6da8ea26-7838-42ec-b9cc-f65e72fcd998 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:23.094758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6da8ea26-7838-42ec-b9cc-f65e72fcd998 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.244090 Jul 21 06:38:23.095343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 565/1122] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:22 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:24.112778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1f3f2d20-21b0-48d0-aa82-b9445beeeb2d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:24.113406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1f3f2d20-21b0-48d0-aa82-b9445beeeb2d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:24.119670 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1f3f2d20-21b0-48d0-aa82-b9445beeeb2d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:24.120127 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1f3f2d20-21b0-48d0-aa82-b9445beeeb2d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:24.120900 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1f3f2d20-21b0-48d0-aa82-b9445beeeb2d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:24.121342 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1f3f2d20-21b0-48d0-aa82-b9445beeeb2d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:24.251018 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9755954a-8eea-4f25-a3da-7ee6bec5dd95 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:24.251621 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-9755954a-8eea-4f25-a3da-7ee6bec5dd95 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:24.253235 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1f3f2d20-21b0-48d0-aa82-b9445beeeb2d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:24.258243 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9755954a-8eea-4f25-a3da-7ee6bec5dd95 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:24.258702 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9755954a-8eea-4f25-a3da-7ee6bec5dd95 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:24.259471 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9755954a-8eea-4f25-a3da-7ee6bec5dd95 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:24.259910 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-9755954a-8eea-4f25-a3da-7ee6bec5dd95 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:24.260628 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1f3f2d20-21b0-48d0-aa82-b9445beeeb2d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.153082 Jul 21 06:38:24.261196 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 558/1123] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:24 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:24.273485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-9755954a-8eea-4f25-a3da-7ee6bec5dd95 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] HTTP exception thrown: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9755954a-8eea-4f25-a3da-7ee6bec5dd95 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Request method failure captured: Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 HTTP/1.1 Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKLcBiTB48bwhPpmkRPF1O0ifR98sZqcVjQPZfkOMEv4bvmkZSwj78LCYfaxFbR_7GRJsNFBrxYCvmw99n3FzVA3eDgxRq2hC1xZlapH5WF_fxkxARBEoxbyFYQPSq2xXmxA2xXWg7MFo_JBQLTRiOZ1UWIpJqA-rXybEfOLADhg5U Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:38:24.275101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2be6e5aedba545f4b562423c55ddbf80"}]}] Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 15ec5e26839f494e98ec70ac49ebe415 Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:24.276869 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'd6ff60b2-b16b-481d-8396-016f9068bff1'} Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:24.278102 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:24.279663 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:24.281738 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-9755954a-8eea-4f25-a3da-7ee6bec5dd95 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Returning 404 to user: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:24.281738 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-9755954a-8eea-4f25-a3da-7ee6bec5dd95 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 404 len: 111 microversion: 2.20 time: 0.030225 Jul 21 06:38:24.281738 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 566/1124] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jul 21 06:38:24 2022] DELETE /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 21 06:38:24.285238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-be42ef87-33e2-4d40-8fa3-396d3977e829 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:24.285842 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-be42ef87-33e2-4d40-8fa3-396d3977e829 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: d6ff60b2-b16b-481d-8396-016f9068bff1] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:24.291794 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-be42ef87-33e2-4d40-8fa3-396d3977e829 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:24.292243 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-be42ef87-33e2-4d40-8fa3-396d3977e829 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:24.292995 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-be42ef87-33e2-4d40-8fa3-396d3977e829 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:24.293428 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-be42ef87-33e2-4d40-8fa3-396d3977e829 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:24.307160 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-be42ef87-33e2-4d40-8fa3-396d3977e829 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] HTTP exception thrown: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-be42ef87-33e2-4d40-8fa3-396d3977e829 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Request method failure captured: Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 HTTP/1.1 Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKLcBiTB48bwhPpmkRPF1O0ifR98sZqcVjQPZfkOMEv4bvmkZSwj78LCYfaxFbR_7GRJsNFBrxYCvmw99n3FzVA3eDgxRq2hC1xZlapH5WF_fxkxARBEoxbyFYQPSq2xXmxA2xXWg7MFo_JBQLTRiOZ1UWIpJqA-rXybEfOLADhg5U Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:38:24.308909 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2be6e5aedba545f4b562423c55ddbf80"}]}] Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 15ec5e26839f494e98ec70ac49ebe415 Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:24.310972 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': 'd6ff60b2-b16b-481d-8396-016f9068bff1'} Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:24.312882 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. Jul 21 06:38:24.314820 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:24.316168 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-be42ef87-33e2-4d40-8fa3-396d3977e829 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Returning 404 to user: Instance d6ff60b2-b16b-481d-8396-016f9068bff1 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:24.316168 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-be42ef87-33e2-4d40-8fa3-396d3977e829 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1" status: 404 len: 111 microversion: 2.20 time: 0.029246 Jul 21 06:38:24.316168 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 559/1125] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:24 2022] GET /compute/v2.1/servers/d6ff60b2-b16b-481d-8396-016f9068bff1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 21 06:38:25.279082 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5a4a9475-45d9-4379-88d0-8bca7c4d2f66 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:25.279703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5a4a9475-45d9-4379-88d0-8bca7c4d2f66 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:25.286418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5a4a9475-45d9-4379-88d0-8bca7c4d2f66 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:25.286868 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5a4a9475-45d9-4379-88d0-8bca7c4d2f66 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:25.287626 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5a4a9475-45d9-4379-88d0-8bca7c4d2f66 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:25.288060 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5a4a9475-45d9-4379-88d0-8bca7c4d2f66 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:25.426677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5a4a9475-45d9-4379-88d0-8bca7c4d2f66 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:25.440452 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5a4a9475-45d9-4379-88d0-8bca7c4d2f66 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.165427 Jul 21 06:38:25.447897 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 567/1126] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:25 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:26.458170 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-91cf01fd-f19a-44aa-bf54-820ab2b278a0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:26.458700 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-91cf01fd-f19a-44aa-bf54-820ab2b278a0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:26.465150 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-91cf01fd-f19a-44aa-bf54-820ab2b278a0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:26.465598 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-91cf01fd-f19a-44aa-bf54-820ab2b278a0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:26.466456 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-91cf01fd-f19a-44aa-bf54-820ab2b278a0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:26.466891 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-91cf01fd-f19a-44aa-bf54-820ab2b278a0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:26.596173 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-91cf01fd-f19a-44aa-bf54-820ab2b278a0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:26.604193 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-91cf01fd-f19a-44aa-bf54-820ab2b278a0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.150059 Jul 21 06:38:26.604753 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 560/1127] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:26 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:27.547677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3d52a9a3-a3ae-4461-bbbc-1454aa902d44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:27.548393 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3d52a9a3-a3ae-4461-bbbc-1454aa902d44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:27.556812 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d52a9a3-a3ae-4461-bbbc-1454aa902d44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:27.557575 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d52a9a3-a3ae-4461-bbbc-1454aa902d44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:27.558449 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d52a9a3-a3ae-4461-bbbc-1454aa902d44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:27.558952 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3d52a9a3-a3ae-4461-bbbc-1454aa902d44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:27.578445 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-3d52a9a3-a3ae-4461-bbbc-1454aa902d44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] HTTP exception thrown: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3d52a9a3-a3ae-4461-bbbc-1454aa902d44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Request method failure captured: Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd HTTP/1.1 Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PKLcBiTB48bwhPpmkRPF1O0ifR98sZqcVjQPZfkOMEv4bvmkZSwj78LCYfaxFbR_7GRJsNFBrxYCvmw99n3FzVA3eDgxRq2hC1xZlapH5WF_fxkxARBEoxbyFYQPSq2xXmxA2xXWg7MFo_JBQLTRiOZ1UWIpJqA-rXybEfOLADhg5U Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:38:27.580274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2be6e5aedba545f4b562423c55ddbf80"}]}] Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 15ec5e26839f494e98ec70ac49ebe415 Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:38:27.582078 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'a40d32b1-a161-49f9-a2ae-fe794e9a66cd'} Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:27.582993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:38:27.584672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:27.586246 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3d52a9a3-a3ae-4461-bbbc-1454aa902d44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Returning 404 to user: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:27.586246 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3d52a9a3-a3ae-4461-bbbc-1454aa902d44 tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 404 len: 111 microversion: 2.20 time: 0.040007 Jul 21 06:38:27.586246 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 568/1128] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jul 21 06:38:27 2022] DELETE /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 06:38:27.591572 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-de897f22-ff3b-4650-9372-0c27f3f231ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:27.592177 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-de897f22-ff3b-4650-9372-0c27f3f231ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] [instance: a40d32b1-a161-49f9-a2ae-fe794e9a66cd] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:27.598984 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-de897f22-ff3b-4650-9372-0c27f3f231ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:27.599366 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-de897f22-ff3b-4650-9372-0c27f3f231ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:27.600181 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-de897f22-ff3b-4650-9372-0c27f3f231ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:27.600591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-de897f22-ff3b-4650-9372-0c27f3f231ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:27.614579 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-de897f22-ff3b-4650-9372-0c27f3f231ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] HTTP exception thrown: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-de897f22-ff3b-4650-9372-0c27f3f231ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Request method failure captured: Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd HTTP/1.1 Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PKLcBiTB48bwhPpmkRPF1O0ifR98sZqcVjQPZfkOMEv4bvmkZSwj78LCYfaxFbR_7GRJsNFBrxYCvmw99n3FzVA3eDgxRq2hC1xZlapH5WF_fxkxARBEoxbyFYQPSq2xXmxA2xXWg7MFo_JBQLTRiOZ1UWIpJqA-rXybEfOLADhg5U Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:38:27.616613 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2be6e5aedba545f4b562423c55ddbf80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2be6e5aedba545f4b562423c55ddbf80"}]}] Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: 2be6e5aedba545f4b562423c55ddbf80 Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1930095569 Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 15ec5e26839f494e98ec70ac49ebe415 Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1930095569-project Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: > Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:38:27.618441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': 'a40d32b1-a161-49f9-a2ae-fe794e9a66cd'} Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:27.619328 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. Jul 21 06:38:27.621519 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:27.623889 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-de897f22-ff3b-4650-9372-0c27f3f231ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] Returning 404 to user: Instance a40d32b1-a161-49f9-a2ae-fe794e9a66cd could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:27.623889 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-de897f22-ff3b-4650-9372-0c27f3f231ed tempest-AttachVolumeShelveTestJSON-1930095569 tempest-AttachVolumeShelveTestJSON-1930095569-project] 10.222.0.42 "GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd" status: 404 len: 111 microversion: 2.20 time: 0.030486 Jul 21 06:38:27.623889 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 561/1129] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 06:38:27 2022] GET /compute/v2.1/servers/a40d32b1-a161-49f9-a2ae-fe794e9a66cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 06:38:27.625482 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4bb79af6-6502-4fab-bf27-5d0d18381098 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:27.625482 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4bb79af6-6502-4fab-bf27-5d0d18381098 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:27.630880 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4bb79af6-6502-4fab-bf27-5d0d18381098 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:27.631442 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4bb79af6-6502-4fab-bf27-5d0d18381098 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:27.632233 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4bb79af6-6502-4fab-bf27-5d0d18381098 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:27.632790 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4bb79af6-6502-4fab-bf27-5d0d18381098 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:27.769619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-4bb79af6-6502-4fab-bf27-5d0d18381098 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:27.777402 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4bb79af6-6502-4fab-bf27-5d0d18381098 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.160657 Jul 21 06:38:27.778271 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 569/1130] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:27 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:28.793831 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-38244b36-76e3-4647-864a-d0d9c5b7cd30 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:28.794467 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-38244b36-76e3-4647-864a-d0d9c5b7cd30 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:28.801150 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-38244b36-76e3-4647-864a-d0d9c5b7cd30 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:28.801606 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-38244b36-76e3-4647-864a-d0d9c5b7cd30 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:28.802414 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-38244b36-76e3-4647-864a-d0d9c5b7cd30 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:28.802854 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-38244b36-76e3-4647-864a-d0d9c5b7cd30 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:29.011223 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-38244b36-76e3-4647-864a-d0d9c5b7cd30 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:29.021230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-38244b36-76e3-4647-864a-d0d9c5b7cd30 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.231031 Jul 21 06:38:29.022209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 562/1131] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:28 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:29.251350 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-5632fa0d-555a-43d6-9211-04ac1ab0bcd6 req-ff791ea9-23c3-4faa-b015-7c0793dee637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1640afc0-f117-498d-b7aa-c8905ac22c7f", "name": "network-vif-plugged", "status": "completed", "tag": "079bd124-28ea-4a24-82cf-3ee1ee8d3689"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:38:29.270882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-5632fa0d-555a-43d6-9211-04ac1ab0bcd6 req-ff791ea9-23c3-4faa-b015-7c0793dee637 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:29.271717 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-5632fa0d-555a-43d6-9211-04ac1ab0bcd6 req-ff791ea9-23c3-4faa-b015-7c0793dee637 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:29.292330 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-5632fa0d-555a-43d6-9211-04ac1ab0bcd6 req-ff791ea9-23c3-4faa-b015-7c0793dee637 service nova] Creating event network-vif-plugged:079bd124-28ea-4a24-82cf-3ee1ee8d3689 for instance 1640afc0-f117-498d-b7aa-c8905ac22c7f on hv-cinder-85031 Jul 21 06:38:29.315748 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-5632fa0d-555a-43d6-9211-04ac1ab0bcd6 req-ff791ea9-23c3-4faa-b015-7c0793dee637 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068947 Jul 21 06:38:29.320877 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 570/1132] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:38:30.041418 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-cc2d1537-2a5b-458e-87f9-f239bc56e113 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:30.042188 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-cc2d1537-2a5b-458e-87f9-f239bc56e113 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:30.062931 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc2d1537-2a5b-458e-87f9-f239bc56e113 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:30.063956 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc2d1537-2a5b-458e-87f9-f239bc56e113 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:30.064946 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc2d1537-2a5b-458e-87f9-f239bc56e113 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:30.065559 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-cc2d1537-2a5b-458e-87f9-f239bc56e113 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:30.241152 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-cc2d1537-2a5b-458e-87f9-f239bc56e113 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:30.254645 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-cc2d1537-2a5b-458e-87f9-f239bc56e113 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1265 microversion: 2.1 time: 0.217896 Jul 21 06:38:30.255875 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 563/1133] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:30 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:31.279537 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-3fd0607c-1a0d-49cc-afa7-4d7b5988ecd9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:31.280511 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-3fd0607c-1a0d-49cc-afa7-4d7b5988ecd9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:31.292651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:31.295791 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3fd0607c-1a0d-49cc-afa7-4d7b5988ecd9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:31.298677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3fd0607c-1a0d-49cc-afa7-4d7b5988ecd9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:31.299899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3fd0607c-1a0d-49cc-afa7-4d7b5988ecd9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:31.300568 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-3fd0607c-1a0d-49cc-afa7-4d7b5988ecd9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:31.308749 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:31.505757 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-3fd0607c-1a0d-49cc-afa7-4d7b5988ecd9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:31.513903 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-3fd0607c-1a0d-49cc-afa7-4d7b5988ecd9 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1452 microversion: 2.1 time: 0.244667 Jul 21 06:38:31.514599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 571/1134] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:31 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1452 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:38:31.534874 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ee0edbf7-a109-405f-8670-1b2236aa2d93 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:31.535610 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ee0edbf7-a109-405f-8670-1b2236aa2d93 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:38:31.538229 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:31.544292 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ee0edbf7-a109-405f-8670-1b2236aa2d93 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:31.544756 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ee0edbf7-a109-405f-8670-1b2236aa2d93 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:31.545553 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ee0edbf7-a109-405f-8670-1b2236aa2d93 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:31.546027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ee0edbf7-a109-405f-8670-1b2236aa2d93 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:31.553312 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=95 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:38:31.788895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ee0edbf7-a109-405f-8670-1b2236aa2d93 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:38:31.799114 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ee0edbf7-a109-405f-8670-1b2236aa2d93 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1452 microversion: 2.1 time: 0.268786 Jul 21 06:38:31.799708 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 564/1135] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:38:31 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1452 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:38:33.612946 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ff63a822-cbd1-4827-b955-589ac6d0de46 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Action: 'create', calling method: .version_select at 0x7f9327c43dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1034370595", "metadata": {"Type": "work"}}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ff63a822-cbd1-4827-b955-589ac6d0de46 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Request method failure captured: Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 122 Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PRp7nEyLpoCMMtkjbji-RgbK7ELxnJKogrhocFaH-qR06RLem6y2dmhj6SnbOOoFbBaifRZCHc0jgvHYV_XkRozzxxYNnnK1Gf7Jh7bG_kFKb0bGH5MQDUfawHZZuBoYqTqgHOX5EftL7G6x5d8UAAUBRw7p-6awNcNjVZSDduusoI Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:38:33.656181 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e707a56bc1944837b26f6306784d3012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e707a56bc1944837b26f6306784d3012"}]}] Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 6d37f54f6721419b8428487153d9a89c Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1034370595", "metadata": {"Type": "work"}}} Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: Jul 21 06:38:33.658490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1034370595', 'metadata': {'Type': 'work'}}}} Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise error Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:33.659561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 06:38:33.663241 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 06:38:33.667237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 06:38:33.667237 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.671052 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ff63a822-cbd1-4827-b955-589ac6d0de46 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:33.672088 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ff63a822-cbd1-4827-b955-589ac6d0de46 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.381101 Jul 21 06:38:33.672582 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 572/1136] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jul 21 06:38:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 383 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 06:38:33.683641 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6bca684e-fd8f-4ed8-b191-42b9fc4b1168 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Action: 'create', calling method: .version_select at 0x7f9327e06af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1827635407", "metadata": {"Type": "work"}}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6bca684e-fd8f-4ed8-b191-42b9fc4b1168 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Request method failure captured: Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 120 Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PRp7nEyLpoCMMtkjbji-RgbK7ELxnJKogrhocFaH-qR06RLem6y2dmhj6SnbOOoFbBaifRZCHc0jgvHYV_XkRozzxxYNnnK1Gf7Jh7bG_kFKb0bGH5MQDUfawHZZuBoYqTqgHOX5EftL7G6x5d8UAAUBRw7p-6awNcNjVZSDduusoI Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:38:33.692591 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e707a56bc1944837b26f6306784d3012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e707a56bc1944837b26f6306784d3012"}]}] Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 6d37f54f6721419b8428487153d9a89c Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1827635407", "metadata": {"Type": "work"}}} Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: Jul 21 06:38:33.693921 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1827635407', 'metadata': {'Type': 'work'}}}} Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise error Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi '0' Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:33.695330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 06:38:33.696724 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 06:38:33.698551 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 06:38:33.698551 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.698551 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-6bca684e-fd8f-4ed8-b191-42b9fc4b1168 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:33.698551 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-6bca684e-fd8f-4ed8-b191-42b9fc4b1168 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014515 Jul 21 06:38:33.698551 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 565/1137] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jul 21 06:38:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 06:38:33.708216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a671581c-79fb-4341-b1f4-dee63c3e87cf tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Action: 'create', calling method: .version_select at 0x7f9327bf88b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1872498864", "metadata": {"Type": "work"}}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a671581c-79fb-4341-b1f4-dee63c3e87cf tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Request method failure captured: Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 119 Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PRp7nEyLpoCMMtkjbji-RgbK7ELxnJKogrhocFaH-qR06RLem6y2dmhj6SnbOOoFbBaifRZCHc0jgvHYV_XkRozzxxYNnnK1Gf7Jh7bG_kFKb0bGH5MQDUfawHZZuBoYqTqgHOX5EftL7G6x5d8UAAUBRw7p-6awNcNjVZSDduusoI Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:38:33.711977 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e707a56bc1944837b26f6306784d3012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e707a56bc1944837b26f6306784d3012"}]}] Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 6d37f54f6721419b8428487153d9a89c Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1872498864", "metadata": {"Type": "work"}}} Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: Jul 21 06:38:33.713677 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1872498864', 'metadata': {'Type': 'work'}}}} Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise error Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi '' Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:33.715025 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 06:38:33.717714 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 06:38:33.720641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 06:38:33.720641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.720641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a671581c-79fb-4341-b1f4-dee63c3e87cf tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:33.720641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a671581c-79fb-4341-b1f4-dee63c3e87cf tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014620 Jul 21 06:38:33.720641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 573/1138] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jul 21 06:38:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 06:38:33.729332 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-86b07fbb-846d-43e9-a2de-2c93b63498d2 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Calling method '.version_select at 0x7f93383c9700>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:33.771728 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-86b07fbb-846d-43e9-a2de-2c93b63498d2 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] HTTP exception thrown: Volume tempest-invalid-1909197419 could not be found. Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-86b07fbb-846d-43e9-a2de-2c93b63498d2 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Request method failure captured: Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1909197419 HTTP/1.1 Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PRp7nEyLpoCMMtkjbji-RgbK7ELxnJKogrhocFaH-qR06RLem6y2dmhj6SnbOOoFbBaifRZCHc0jgvHYV_XkRozzxxYNnnK1Gf7Jh7bG_kFKb0bGH5MQDUfawHZZuBoYqTqgHOX5EftL7G6x5d8UAAUBRw7p-6awNcNjVZSDduusoI Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:38:33.774098 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e707a56bc1944837b26f6306784d3012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e707a56bc1944837b26f6306784d3012"}]}] Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 6d37f54f6721419b8428487153d9a89c Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Volume tempest-invalid-1909197419 could not be found. Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': 'tempest-invalid-1909197419'} Jul 21 06:38:33.776239 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1909197419 could not be found. (HTTP 404) (Request-ID: req-908df814-6d70-412d-87b5-55c544817459) Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.777473 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 06:38:33.779716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1909197419 could not be found. Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:33.782413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1909197419 could not be found. Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1909197419 could not be found. Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-86b07fbb-846d-43e9-a2de-2c93b63498d2 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Returning 404 to user: Volume tempest-invalid-1909197419 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-86b07fbb-846d-43e9-a2de-2c93b63498d2 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1909197419" status: 404 len: 99 microversion: 2.1 time: 0.051012 Jul 21 06:38:33.784855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 566/1139] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jul 21 06:38:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1909197419 => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 06:38:33.788490 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-cb94689f-3a81-4da2-94b9-34102e773faf tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005258 Jul 21 06:38:33.792705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 574/1140] 10.222.0.42 () {58 vars in 1139 bytes} [Thu Jul 21 06:38:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 06:38:33.797905 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-afa770e8-a974-4ad2-86e4-029017f316a8 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003687 Jul 21 06:38:33.798826 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 567/1141] 10.222.0.42 () {58 vars in 1136 bytes} [Thu Jul 21 06:38:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 21 06:38:33.809341 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-25c515be-b93f-4031-9613-1586c13ed0a5 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Calling method '.version_select at 0x7f9327e25550>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:33.853356 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-25c515be-b93f-4031-9613-1586c13ed0a5 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] HTTP exception thrown: Volume 667debc7-66f4-44aa-94a9-c3460c340222 could not be found. Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-25c515be-b93f-4031-9613-1586c13ed0a5 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Request method failure captured: Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/os-volumes/667debc7-66f4-44aa-94a9-c3460c340222 HTTP/1.1 Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PRp7nEyLpoCMMtkjbji-RgbK7ELxnJKogrhocFaH-qR06RLem6y2dmhj6SnbOOoFbBaifRZCHc0jgvHYV_XkRozzxxYNnnK1Gf7Jh7bG_kFKb0bGH5MQDUfawHZZuBoYqTqgHOX5EftL7G6x5d8UAAUBRw7p-6awNcNjVZSDduusoI Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:38:33.856314 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e707a56bc1944837b26f6306784d3012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e707a56bc1944837b26f6306784d3012"}]}] Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 6d37f54f6721419b8428487153d9a89c Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Volume 667debc7-66f4-44aa-94a9-c3460c340222 could not be found. Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '667debc7-66f4-44aa-94a9-c3460c340222'} Jul 21 06:38:33.857827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 667debc7-66f4-44aa-94a9-c3460c340222 could not be found. (HTTP 404) (Request-ID: req-350f9fc3-4333-4b48-8422-33901db44e40) Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.858703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 06:38:33.862072 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 667debc7-66f4-44aa-94a9-c3460c340222 could not be found. Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 06:38:33.865138 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 667debc7-66f4-44aa-94a9-c3460c340222 could not be found. Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 667debc7-66f4-44aa-94a9-c3460c340222 could not be found. Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-25c515be-b93f-4031-9613-1586c13ed0a5 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Returning 404 to user: Volume 667debc7-66f4-44aa-94a9-c3460c340222 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:33.870259 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-25c515be-b93f-4031-9613-1586c13ed0a5 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/667debc7-66f4-44aa-94a9-c3460c340222" status: 404 len: 109 microversion: 2.1 time: 0.062818 Jul 21 06:38:33.872958 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 575/1142] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 06:38:33 2022] DELETE /compute/v2.1/os-volumes/667debc7-66f4-44aa-94a9-c3460c340222 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:38:33.883653 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-faf42ce7-54c3-4755-9ce4-6f6fb7395403 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Calling method '.version_select at 0x7f9327b7ce50>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:38:33.920710 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.wsgi [None req-faf42ce7-54c3-4755-9ce4-6f6fb7395403 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] HTTP exception thrown: Volume 1a3c6f7a-8ffd-4f10-9826-66ca62696e72 could not be found. Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-faf42ce7-54c3-4755-9ce4-6f6fb7395403 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Request method failure captured: Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: request: GET /compute/v2.1/os-volumes/1a3c6f7a-8ffd-4f10-9826-66ca62696e72 HTTP/1.1 Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept: application/json Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Accept-Encoding: identity Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Connection: close Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Length: 0 Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Content-Type: application/json Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Host: 10.222.0.42 Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Openstack-System-Scope: None Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: User-Agent: python-urllib3/1.26.9 Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Auth-Token: gAAAAABi2PRp7nEyLpoCMMtkjbji-RgbK7ELxnJKogrhocFaH-qR06RLem6y2dmhj6SnbOOoFbBaifRZCHc0jgvHYV_XkRozzxxYNnnK1Gf7Jh7bG_kFKb0bGH5MQDUfawHZZuBoYqTqgHOX5EftL7G6x5d8UAAUBRw7p-6awNcNjVZSDduusoI Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Id: None Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Domain-Name: None Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Identity-Status: Confirmed Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Is-Admin-Project: True Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Id: default Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Domain-Name: Default Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Project-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Role: reader,member Jul 21 06:38:33.923205 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Roles: reader,member Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e707a56bc1944837b26f6306784d3012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e707a56bc1944837b26f6306784d3012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e707a56bc1944837b26f6306784d3012"}]}] Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Id: e707a56bc1944837b26f6306784d3012 Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-Tenant-Name: tempest-VolumesNegativeTest-1309026570 Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Id: default Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Domain-Name: Default Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Id: 6d37f54f6721419b8428487153d9a89c Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: X-User-Name: tempest-VolumesNegativeTest-1309026570-project Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: method: Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: exception: Volume 1a3c6f7a-8ffd-4f10-9826-66ca62696e72 could not be found. Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: action_args: {'id': '1a3c6f7a-8ffd-4f10-9826-66ca62696e72'} Jul 21 06:38:33.924785 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a3c6f7a-8ffd-4f10-9826-66ca62696e72 could not be found. (HTTP 404) (Request-ID: req-3cb6575e-a93d-4085-ae05-fabd0bd4b1f5) Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.925660 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 06:38:33.926934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a3c6f7a-8ffd-4f10-9826-66ca62696e72 could not be found. Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 06:38:33.928197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a3c6f7a-8ffd-4f10-9826-66ca62696e72 could not be found. Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a3c6f7a-8ffd-4f10-9826-66ca62696e72 could not be found. Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: ERROR nova.api.openstack.wsgi Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-faf42ce7-54c3-4755-9ce4-6f6fb7395403 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] Returning 404 to user: Volume 1a3c6f7a-8ffd-4f10-9826-66ca62696e72 could not be found. {{(pid=117905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-faf42ce7-54c3-4755-9ce4-6f6fb7395403 tempest-VolumesNegativeTest-1309026570 tempest-VolumesNegativeTest-1309026570-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/1a3c6f7a-8ffd-4f10-9826-66ca62696e72" status: 404 len: 109 microversion: 2.1 time: 0.045912 Jul 21 06:38:33.932750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 568/1143] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 06:38:33 2022] GET /compute/v2.1/os-volumes/1a3c6f7a-8ffd-4f10-9826-66ca62696e72 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:38:34.428620 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-8479a9dc-de3b-4ad1-904d-b8ccce00d3b6 req-0532bbea-05bf-423b-b41c-6e7beb46e4be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1640afc0-f117-498d-b7aa-c8905ac22c7f", "tag": "079bd124-28ea-4a24-82cf-3ee1ee8d3689"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:38:34.444206 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-8479a9dc-de3b-4ad1-904d-b8ccce00d3b6 req-0532bbea-05bf-423b-b41c-6e7beb46e4be service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:38:34.444652 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-8479a9dc-de3b-4ad1-904d-b8ccce00d3b6 req-0532bbea-05bf-423b-b41c-6e7beb46e4be service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:38:34.469570 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-8479a9dc-de3b-4ad1-904d-b8ccce00d3b6 req-0532bbea-05bf-423b-b41c-6e7beb46e4be service nova] Creating event network-changed:079bd124-28ea-4a24-82cf-3ee1ee8d3689 for instance 1640afc0-f117-498d-b7aa-c8905ac22c7f on hv-cinder-85031 Jul 21 06:38:34.479555 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-8479a9dc-de3b-4ad1-904d-b8ccce00d3b6 req-0532bbea-05bf-423b-b41c-6e7beb46e4be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056492 Jul 21 06:38:34.489775 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 576/1144] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:39:06.995433 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:06.996198 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=5 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:07.001637 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-92a34515-52f2-44b2-9161-48bb828c45cd tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Action: 'create', calling method: .version_select at 0x7f9327b5b430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1781095075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQb5csRbK1mnwL9IaXV9Ks9QnthK5/6+d8obJZ7GLgHxDSLQBgHmZGrJQMKPsOL/XQ2nBubU7Y1QsXYVg1kKdZRoYjHOiko0VlCh7sexkBkSIkxu+cH0CFoTgUlPIqSSw=="}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:39:07.017053 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-92a34515-52f2-44b2-9161-48bb828c45cd tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Getting quotas for project 9ba482e050244bc6a359090a616658ec. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:39:07.020816 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.quota [None req-92a34515-52f2-44b2-9161-48bb828c45cd tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Getting quotas for user 756c74602c4d4bafade01c406ffd6afc and project 9ba482e050244bc6a359090a616658ec. Resources: {'key_pairs'} {{(pid=117905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:39:07.049867 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-92a34515-52f2-44b2-9161-48bb828c45cd tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055997 Jul 21 06:39:07.051074 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 569/1145] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 06:39:06 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:39:07.147422 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:07.148540 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=6 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:07.152583 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2040840061", "imageRef": "2072371e-c10e-49ba-b1ea-da71acd107cf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1781095075", "networks": [{"uuid": "87d8d15e-a080-4012-90f0-f7a65ac40143"}]}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:39:07.204642 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.network.neutron [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] validate_networks() for [('87d8d15e-a080-4012-90f0-f7a65ac40143', None, None, None, None, None)] {{(pid=117906) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:39:07.591480 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Flavor limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:39:07.592089 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Image limits 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:39:07.592798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Flavor pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:39:07.593411 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Image pref 0:0:0 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:39:07.594108 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.virt.hardware [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:39:07.606006 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:07.606640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:07.607748 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:07.608351 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:07.627843 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Getting quotas for project 9ba482e050244bc6a359090a616658ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:39:07.631872 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.quota [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Getting quotas for user 756c74602c4d4bafade01c406ffd6afc and project 9ba482e050244bc6a359090a616658ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:39:07.643928 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Going to run 1 instances... {{(pid=117906) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:39:07.646433 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2072371e-c10e-49ba-b1ea-da71acd107cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:39:07.692347 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-19bd57aa-a6e1-43ee-be3d-4ab63b9d3cca tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546417 Jul 21 06:39:07.693348 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 577/1146] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 06:39:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:39:07.703335 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c2b48dac-8ad9-4024-a42d-8b8d0ea9e2d2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:07.704627 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c2b48dac-8ad9-4024-a42d-8b8d0ea9e2d2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:07.760614 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c2b48dac-8ad9-4024-a42d-8b8d0ea9e2d2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:07.768434 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c2b48dac-8ad9-4024-a42d-8b8d0ea9e2d2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1259 microversion: 2.1 time: 0.069042 Jul 21 06:39:07.768996 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 570/1147] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:07 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:08.785981 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-12f1c67e-b7b9-49e5-8113-812a76e51011 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:08.786597 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-12f1c67e-b7b9-49e5-8113-812a76e51011 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:08.794336 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-12f1c67e-b7b9-49e5-8113-812a76e51011 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:08.794784 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-12f1c67e-b7b9-49e5-8113-812a76e51011 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:08.795551 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-12f1c67e-b7b9-49e5-8113-812a76e51011 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:08.795986 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-12f1c67e-b7b9-49e5-8113-812a76e51011 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:08.866221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-12f1c67e-b7b9-49e5-8113-812a76e51011 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:08.873582 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-12f1c67e-b7b9-49e5-8113-812a76e51011 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1311 microversion: 2.1 time: 0.092500 Jul 21 06:39:08.874176 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 578/1148] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:08 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:39:09.894285 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8707559d-bfe3-4ad1-a534-afae3cecb29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:09.896370 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8707559d-bfe3-4ad1-a534-afae3cecb29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:09.907429 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8707559d-bfe3-4ad1-a534-afae3cecb29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:09.908173 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8707559d-bfe3-4ad1-a534-afae3cecb29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:09.909144 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8707559d-bfe3-4ad1-a534-afae3cecb29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:09.909778 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8707559d-bfe3-4ad1-a534-afae3cecb29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:10.130053 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8707559d-bfe3-4ad1-a534-afae3cecb29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:10.146664 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8707559d-bfe3-4ad1-a534-afae3cecb29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.258910 Jul 21 06:39:10.161837 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 571/1149] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:09 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:11.165658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-45ec88a0-49c7-4f9a-9bc7-2b503cee0a35 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:11.166316 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-45ec88a0-49c7-4f9a-9bc7-2b503cee0a35 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:11.173967 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-45ec88a0-49c7-4f9a-9bc7-2b503cee0a35 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:11.174587 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-45ec88a0-49c7-4f9a-9bc7-2b503cee0a35 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:11.175480 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-45ec88a0-49c7-4f9a-9bc7-2b503cee0a35 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:11.176071 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-45ec88a0-49c7-4f9a-9bc7-2b503cee0a35 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:11.321924 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-45ec88a0-49c7-4f9a-9bc7-2b503cee0a35 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:11.330344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-45ec88a0-49c7-4f9a-9bc7-2b503cee0a35 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.168486 Jul 21 06:39:11.330928 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 579/1150] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:11 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:12.348659 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0b49de98-bb19-491b-bc32-71e3a6bf30b7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:12.349402 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0b49de98-bb19-491b-bc32-71e3a6bf30b7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:12.355932 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0b49de98-bb19-491b-bc32-71e3a6bf30b7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:12.356827 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0b49de98-bb19-491b-bc32-71e3a6bf30b7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:12.358357 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0b49de98-bb19-491b-bc32-71e3a6bf30b7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:12.359074 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0b49de98-bb19-491b-bc32-71e3a6bf30b7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:12.543386 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0b49de98-bb19-491b-bc32-71e3a6bf30b7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:12.551231 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0b49de98-bb19-491b-bc32-71e3a6bf30b7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.207825 Jul 21 06:39:12.551805 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 572/1151] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:12 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:13.570031 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-01e09bdc-069e-43cc-8be2-d80a3da33a74 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:13.571710 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-01e09bdc-069e-43cc-8be2-d80a3da33a74 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:13.582422 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-01e09bdc-069e-43cc-8be2-d80a3da33a74 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:13.582972 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-01e09bdc-069e-43cc-8be2-d80a3da33a74 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:13.583683 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-01e09bdc-069e-43cc-8be2-d80a3da33a74 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:13.584121 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-01e09bdc-069e-43cc-8be2-d80a3da33a74 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:13.740080 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-01e09bdc-069e-43cc-8be2-d80a3da33a74 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:13.754158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-01e09bdc-069e-43cc-8be2-d80a3da33a74 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.188533 Jul 21 06:39:13.755688 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 580/1152] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:13 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:14.773009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-78e51121-5f19-443b-90ee-64b2a3eed1d6 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:14.774314 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-78e51121-5f19-443b-90ee-64b2a3eed1d6 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:14.782249 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-78e51121-5f19-443b-90ee-64b2a3eed1d6 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:14.782878 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-78e51121-5f19-443b-90ee-64b2a3eed1d6 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:14.783382 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-78e51121-5f19-443b-90ee-64b2a3eed1d6 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:14.783802 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-78e51121-5f19-443b-90ee-64b2a3eed1d6 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:14.964738 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-78e51121-5f19-443b-90ee-64b2a3eed1d6 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:14.973695 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-78e51121-5f19-443b-90ee-64b2a3eed1d6 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.204486 Jul 21 06:39:14.974453 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 573/1153] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:14 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:15.990995 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f77b68d6-8834-47b3-98db-1b947df34723 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:15.991614 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f77b68d6-8834-47b3-98db-1b947df34723 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:15.997873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f77b68d6-8834-47b3-98db-1b947df34723 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:15.998589 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f77b68d6-8834-47b3-98db-1b947df34723 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:15.999561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f77b68d6-8834-47b3-98db-1b947df34723 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:16.000175 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f77b68d6-8834-47b3-98db-1b947df34723 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:16.197153 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f77b68d6-8834-47b3-98db-1b947df34723 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:16.208813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f77b68d6-8834-47b3-98db-1b947df34723 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.221841 Jul 21 06:39:16.209465 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 581/1154] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:15 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:17.226562 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-991efa3f-bb79-4d6a-8152-5ad400ad0b9b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:17.230282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-991efa3f-bb79-4d6a-8152-5ad400ad0b9b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:17.238960 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-991efa3f-bb79-4d6a-8152-5ad400ad0b9b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:17.239411 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-991efa3f-bb79-4d6a-8152-5ad400ad0b9b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:17.240391 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-991efa3f-bb79-4d6a-8152-5ad400ad0b9b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:17.240830 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-991efa3f-bb79-4d6a-8152-5ad400ad0b9b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:17.394433 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-991efa3f-bb79-4d6a-8152-5ad400ad0b9b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:17.403431 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-991efa3f-bb79-4d6a-8152-5ad400ad0b9b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.181386 Jul 21 06:39:17.404009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 574/1155] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:17 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:18.420549 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-1bf0d6c6-06e4-4788-b882-9d693942f660 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:18.421159 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-1bf0d6c6-06e4-4788-b882-9d693942f660 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:18.423493 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:18.424209 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=6 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:18.430406 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1bf0d6c6-06e4-4788-b882-9d693942f660 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:18.430848 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1bf0d6c6-06e4-4788-b882-9d693942f660 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:18.431603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1bf0d6c6-06e4-4788-b882-9d693942f660 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:18.432037 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-1bf0d6c6-06e4-4788-b882-9d693942f660 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:18.558333 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-1bf0d6c6-06e4-4788-b882-9d693942f660 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:18.566304 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-1bf0d6c6-06e4-4788-b882-9d693942f660 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.149558 Jul 21 06:39:18.566873 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 582/1156] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:18 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:19.436124 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-ba4f42f7-bb8d-4737-be73-04a7c853500b req-6522d3b6-8b04-48dd-86ce-edb41c79b4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac82ad70-7a1c-40c7-83eb-519088147c76", "tag": "7a899c90-0e7d-4a42-9984-b0e866be244e"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:39:19.443334 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell0:SELECT=6 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:19.448521 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-ba4f42f7-bb8d-4737-be73-04a7c853500b req-6522d3b6-8b04-48dd-86ce-edb41c79b4fd service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:19.449046 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-ba4f42f7-bb8d-4737-be73-04a7c853500b req-6522d3b6-8b04-48dd-86ce-edb41c79b4fd service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:19.462522 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-ba4f42f7-bb8d-4737-be73-04a7c853500b req-6522d3b6-8b04-48dd-86ce-edb41c79b4fd service nova] Creating event network-changed:7a899c90-0e7d-4a42-9984-b0e866be244e for instance ac82ad70-7a1c-40c7-83eb-519088147c76 on hv-cinder-85031 Jul 21 06:39:19.467511 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-ba4f42f7-bb8d-4737-be73-04a7c853500b req-6522d3b6-8b04-48dd-86ce-edb41c79b4fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036266 Jul 21 06:39:19.468456 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 575/1157] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:39:19.583294 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-02c726e7-c2ad-498f-9ba3-9740439025f8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:19.584577 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-02c726e7-c2ad-498f-9ba3-9740439025f8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:19.597018 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-02c726e7-c2ad-498f-9ba3-9740439025f8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:19.597478 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-02c726e7-c2ad-498f-9ba3-9740439025f8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:19.598606 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-02c726e7-c2ad-498f-9ba3-9740439025f8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:19.599865 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-02c726e7-c2ad-498f-9ba3-9740439025f8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:20.014266 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-02c726e7-c2ad-498f-9ba3-9740439025f8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:20.022536 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-02c726e7-c2ad-498f-9ba3-9740439025f8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.443482 Jul 21 06:39:20.023381 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 583/1158] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:19 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:21.041738 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7c9e4bcc-6d95-4690-827b-aa1256e94350 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:21.042479 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7c9e4bcc-6d95-4690-827b-aa1256e94350 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:21.048920 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7c9e4bcc-6d95-4690-827b-aa1256e94350 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:21.049374 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7c9e4bcc-6d95-4690-827b-aa1256e94350 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:21.050202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7c9e4bcc-6d95-4690-827b-aa1256e94350 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:21.050646 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7c9e4bcc-6d95-4690-827b-aa1256e94350 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:21.181399 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7c9e4bcc-6d95-4690-827b-aa1256e94350 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:21.189491 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7c9e4bcc-6d95-4690-827b-aa1256e94350 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.152552 Jul 21 06:39:21.190083 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 576/1159] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:21 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:22.206210 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f15dcdd4-e8f4-406a-b184-4012dfea7693 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:22.206804 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f15dcdd4-e8f4-406a-b184-4012dfea7693 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:22.213244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f15dcdd4-e8f4-406a-b184-4012dfea7693 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:22.213693 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f15dcdd4-e8f4-406a-b184-4012dfea7693 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:22.214503 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f15dcdd4-e8f4-406a-b184-4012dfea7693 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:22.214923 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f15dcdd4-e8f4-406a-b184-4012dfea7693 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:22.348182 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f15dcdd4-e8f4-406a-b184-4012dfea7693 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:22.355664 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f15dcdd4-e8f4-406a-b184-4012dfea7693 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.154326 Jul 21 06:39:22.356235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 584/1160] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:22 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:23.372357 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1689bb9d-e87a-4a19-a556-ab357a7611f5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:23.372980 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1689bb9d-e87a-4a19-a556-ab357a7611f5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:23.379706 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1689bb9d-e87a-4a19-a556-ab357a7611f5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:23.380147 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1689bb9d-e87a-4a19-a556-ab357a7611f5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:23.380951 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1689bb9d-e87a-4a19-a556-ab357a7611f5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:23.381392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1689bb9d-e87a-4a19-a556-ab357a7611f5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:23.513406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1689bb9d-e87a-4a19-a556-ab357a7611f5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:23.522437 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1689bb9d-e87a-4a19-a556-ab357a7611f5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.153886 Jul 21 06:39:23.523015 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 577/1161] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:23 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:24.539338 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5a732d1a-518e-4d21-8acf-329f46f99d21 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:24.540047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5a732d1a-518e-4d21-8acf-329f46f99d21 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:24.546713 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5a732d1a-518e-4d21-8acf-329f46f99d21 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:24.547253 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5a732d1a-518e-4d21-8acf-329f46f99d21 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:24.548211 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5a732d1a-518e-4d21-8acf-329f46f99d21 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:24.548649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5a732d1a-518e-4d21-8acf-329f46f99d21 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:24.720961 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5a732d1a-518e-4d21-8acf-329f46f99d21 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:24.729106 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5a732d1a-518e-4d21-8acf-329f46f99d21 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.193593 Jul 21 06:39:24.730035 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 585/1162] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:24 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:25.663589 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-860f6987-a86a-451f-870f-e9150188cd2c req-6237734d-5b80-411b-8c2c-227ee364dad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac82ad70-7a1c-40c7-83eb-519088147c76", "name": "network-vif-plugged", "status": "completed", "tag": "7a899c90-0e7d-4a42-9984-b0e866be244e"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:39:25.678618 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-860f6987-a86a-451f-870f-e9150188cd2c req-6237734d-5b80-411b-8c2c-227ee364dad1 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:25.679141 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-860f6987-a86a-451f-870f-e9150188cd2c req-6237734d-5b80-411b-8c2c-227ee364dad1 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:25.692129 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-860f6987-a86a-451f-870f-e9150188cd2c req-6237734d-5b80-411b-8c2c-227ee364dad1 service nova] Creating event network-vif-plugged:7a899c90-0e7d-4a42-9984-b0e866be244e for instance ac82ad70-7a1c-40c7-83eb-519088147c76 on hv-cinder-85031 Jul 21 06:39:25.698323 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-860f6987-a86a-451f-870f-e9150188cd2c req-6237734d-5b80-411b-8c2c-227ee364dad1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039065 Jul 21 06:39:25.699877 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 578/1163] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:39:25.749653 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-0b687d8a-2ebf-450f-b109-78ee7c2d735b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:25.751834 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-0b687d8a-2ebf-450f-b109-78ee7c2d735b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:25.758832 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0b687d8a-2ebf-450f-b109-78ee7c2d735b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:25.759658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0b687d8a-2ebf-450f-b109-78ee7c2d735b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:25.761616 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0b687d8a-2ebf-450f-b109-78ee7c2d735b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:25.762320 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-0b687d8a-2ebf-450f-b109-78ee7c2d735b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:25.911304 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-0b687d8a-2ebf-450f-b109-78ee7c2d735b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:25.919103 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-0b687d8a-2ebf-450f-b109-78ee7c2d735b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.175739 Jul 21 06:39:25.919639 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 586/1164] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:25 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:26.936638 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-86570b94-3890-4a50-8a75-5e3a95a78a5d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:26.937347 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-86570b94-3890-4a50-8a75-5e3a95a78a5d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:26.944500 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-86570b94-3890-4a50-8a75-5e3a95a78a5d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:26.944958 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-86570b94-3890-4a50-8a75-5e3a95a78a5d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:26.945732 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-86570b94-3890-4a50-8a75-5e3a95a78a5d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:26.946202 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-86570b94-3890-4a50-8a75-5e3a95a78a5d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:27.083385 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-86570b94-3890-4a50-8a75-5e3a95a78a5d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:27.091889 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-86570b94-3890-4a50-8a75-5e3a95a78a5d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1359 microversion: 2.1 time: 0.159438 Jul 21 06:39:27.092647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 579/1165] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:26 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:28.108599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-7c35b577-74ad-4c3d-b7af-f06e30d9d940 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:28.109216 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-7c35b577-74ad-4c3d-b7af-f06e30d9d940 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:28.116272 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7c35b577-74ad-4c3d-b7af-f06e30d9d940 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:28.116721 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7c35b577-74ad-4c3d-b7af-f06e30d9d940 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:28.117483 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7c35b577-74ad-4c3d-b7af-f06e30d9d940 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:28.117920 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-7c35b577-74ad-4c3d-b7af-f06e30d9d940 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:28.252032 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-7c35b577-74ad-4c3d-b7af-f06e30d9d940 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:28.259481 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-7c35b577-74ad-4c3d-b7af-f06e30d9d940 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1550 microversion: 2.1 time: 0.154814 Jul 21 06:39:28.260049 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 587/1166] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:28 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:28.275297 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4ffce31d-bc9c-4b5c-a9b9-83e5023eb3f2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:28.275914 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4ffce31d-bc9c-4b5c-a9b9-83e5023eb3f2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:28.283781 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ffce31d-bc9c-4b5c-a9b9-83e5023eb3f2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:28.284282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ffce31d-bc9c-4b5c-a9b9-83e5023eb3f2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:28.285063 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ffce31d-bc9c-4b5c-a9b9-83e5023eb3f2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:28.285505 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4ffce31d-bc9c-4b5c-a9b9-83e5023eb3f2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:28.415694 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4ffce31d-bc9c-4b5c-a9b9-83e5023eb3f2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:28.424209 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4ffce31d-bc9c-4b5c-a9b9-83e5023eb3f2 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1550 microversion: 2.1 time: 0.152715 Jul 21 06:39:28.424788 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 580/1167] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:28 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:28.439580 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e8ec908c-620a-45cc-b42d-2c590c72d930 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:28.443036 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e8ec908c-620a-45cc-b42d-2c590c72d930 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:28.443803 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e8ec908c-620a-45cc-b42d-2c590c72d930 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Searching by: {'deleted': False, 'project_id': '9ba482e050244bc6a359090a616658ec'} {{(pid=117906) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 06:39:28.451012 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e8ec908c-620a-45cc-b42d-2c590c72d930 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:28.451605 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e8ec908c-620a-45cc-b42d-2c590c72d930 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:28.452500 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e8ec908c-620a-45cc-b42d-2c590c72d930 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:28.452838 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e8ec908c-620a-45cc-b42d-2c590c72d930 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:28.546802 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.multi_cell_list [None req-e8ec908c-620a-45cc-b42d-2c590c72d930 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117906) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 06:39:28.640391 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e8ec908c-620a-45cc-b42d-2c590c72d930 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204419 Jul 21 06:39:28.641013 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 588/1168] 10.222.0.42 () {58 vars in 1124 bytes} [Thu Jul 21 06:39:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:39:28.652161 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ea9fc1a2-ea7d-47d5-abef-e5cc5858423b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:28.652779 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ea9fc1a2-ea7d-47d5-abef-e5cc5858423b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:28.660197 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ea9fc1a2-ea7d-47d5-abef-e5cc5858423b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:28.660698 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ea9fc1a2-ea7d-47d5-abef-e5cc5858423b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:28.661517 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ea9fc1a2-ea7d-47d5-abef-e5cc5858423b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:28.662163 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ea9fc1a2-ea7d-47d5-abef-e5cc5858423b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:28.812438 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ea9fc1a2-ea7d-47d5-abef-e5cc5858423b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:28.821122 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ea9fc1a2-ea7d-47d5-abef-e5cc5858423b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1550 microversion: 2.1 time: 0.172645 Jul 21 06:39:28.821855 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 581/1169] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:28 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:30.349540 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-342687ab-aeaf-4678-93a0-f2da9ac294bc tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37e852d1-de3f-4d34-9a8c-3f2a6c7371b9"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:39:30.350719 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-342687ab-aeaf-4678-93a0-f2da9ac294bc tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:30.357343 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-342687ab-aeaf-4678-93a0-f2da9ac294bc tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:30.357796 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-342687ab-aeaf-4678-93a0-f2da9ac294bc tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:30.358611 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-342687ab-aeaf-4678-93a0-f2da9ac294bc tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:30.359064 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-342687ab-aeaf-4678-93a0-f2da9ac294bc tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:30.608219 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-342687ab-aeaf-4678-93a0-f2da9ac294bc tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "POST /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262559 Jul 21 06:39:30.608829 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 589/1170] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 06:39:30 2022] POST /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:39:38.150529 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-69954767-3a4f-45be-883c-fa9104020468 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:38.151413 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-69954767-3a4f-45be-883c-fa9104020468 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:38.154068 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:38.160393 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-69954767-3a4f-45be-883c-fa9104020468 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:38.160847 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-69954767-3a4f-45be-883c-fa9104020468 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:38.161628 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-69954767-3a4f-45be-883c-fa9104020468 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:38.162111 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-69954767-3a4f-45be-883c-fa9104020468 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:38.165432 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=59 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:38.296941 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-69954767-3a4f-45be-883c-fa9104020468 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:38.305743 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-69954767-3a4f-45be-883c-fa9104020468 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1596 microversion: 2.1 time: 0.159106 Jul 21 06:39:38.317282 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 582/1171] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:38 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1596 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:40.340498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell0:SELECT=2 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:40.345533 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-eeb02a75-dcfa-41dd-b825-223d930a52ba req-ba9d6fe3-98ae-4463-a7e1-522ba533f766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac82ad70-7a1c-40c7-83eb-519088147c76", "tag": "7a899c90-0e7d-4a42-9984-b0e866be244e"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:39:40.350086 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:40.357026 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-eeb02a75-dcfa-41dd-b825-223d930a52ba req-ba9d6fe3-98ae-4463-a7e1-522ba533f766 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:40.357757 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-eeb02a75-dcfa-41dd-b825-223d930a52ba req-ba9d6fe3-98ae-4463-a7e1-522ba533f766 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:40.363147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:39:40.376156 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-eeb02a75-dcfa-41dd-b825-223d930a52ba req-ba9d6fe3-98ae-4463-a7e1-522ba533f766 service nova] Creating event network-changed:7a899c90-0e7d-4a42-9984-b0e866be244e for instance ac82ad70-7a1c-40c7-83eb-519088147c76 on hv-cinder-85031 Jul 21 06:39:40.382418 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-eeb02a75-dcfa-41dd-b825-223d930a52ba req-ba9d6fe3-98ae-4463-a7e1-522ba533f766 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042825 Jul 21 06:39:40.383427 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 590/1172] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:39:41.505133 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b5375835-a060-427e-89aa-9ab8ef36932a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1817062526"}} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:39:41.505674 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b5375835-a060-427e-89aa-9ab8ef36932a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:41.512371 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b5375835-a060-427e-89aa-9ab8ef36932a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:41.512813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b5375835-a060-427e-89aa-9ab8ef36932a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:41.513650 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b5375835-a060-427e-89aa-9ab8ef36932a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:41.514259 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b5375835-a060-427e-89aa-9ab8ef36932a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:41.658182 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.network.security_group_api [None req-b5375835-a060-427e-89aa-9ab8ef36932a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Adding security group 3a8b39ea-cbe1-4bb0-835c-4c7063fcc2a9 to port 7a899c90-0e7d-4a42-9984-b0e866be244e Jul 21 06:39:42.020733 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b5375835-a060-427e-89aa-9ab8ef36932a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "POST /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/action" status: 202 len: 0 microversion: 2.1 time: 0.516615 Jul 21 06:39:42.022357 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 583/1173] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:39:41 2022] POST /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:39:42.025609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-f43b2648-a900-4e93-a6b4-fb3fadd319e7 req-3f2f6570-223e-4e00-a9c3-37a7c06b75f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac82ad70-7a1c-40c7-83eb-519088147c76", "tag": "7a899c90-0e7d-4a42-9984-b0e866be244e"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:39:42.033528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-f43b2648-a900-4e93-a6b4-fb3fadd319e7 req-3f2f6570-223e-4e00-a9c3-37a7c06b75f6 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:42.034224 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-f43b2648-a900-4e93-a6b4-fb3fadd319e7 req-3f2f6570-223e-4e00-a9c3-37a7c06b75f6 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:42.037821 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-4bb6b35e-8ebe-42c6-ba12-33dfc1cba0d8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:42.040522 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-4bb6b35e-8ebe-42c6-ba12-33dfc1cba0d8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:42.048331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-f43b2648-a900-4e93-a6b4-fb3fadd319e7 req-3f2f6570-223e-4e00-a9c3-37a7c06b75f6 service nova] Creating event network-changed:7a899c90-0e7d-4a42-9984-b0e866be244e for instance ac82ad70-7a1c-40c7-83eb-519088147c76 on hv-cinder-85031 Jul 21 06:39:42.054194 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-f43b2648-a900-4e93-a6b4-fb3fadd319e7 req-3f2f6570-223e-4e00-a9c3-37a7c06b75f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036770 Jul 21 06:39:42.055172 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 591/1174] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:39:42.075103 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4bb6b35e-8ebe-42c6-ba12-33dfc1cba0d8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:42.076321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4bb6b35e-8ebe-42c6-ba12-33dfc1cba0d8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:42.077124 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4bb6b35e-8ebe-42c6-ba12-33dfc1cba0d8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:42.077588 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-4bb6b35e-8ebe-42c6-ba12-33dfc1cba0d8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:42.311385 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-4bb6b35e-8ebe-42c6-ba12-33dfc1cba0d8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:42.327797 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-4bb6b35e-8ebe-42c6-ba12-33dfc1cba0d8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1761 microversion: 2.1 time: 0.299691 Jul 21 06:39:42.340317 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 584/1175] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:42 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1761 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:47.911687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e2425208-8b90-4b71-9fdc-57cf40a0f625 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:39:47.912222 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e2425208-8b90-4b71-9fdc-57cf40a0f625 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:47.918595 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e2425208-8b90-4b71-9fdc-57cf40a0f625 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:47.919038 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e2425208-8b90-4b71-9fdc-57cf40a0f625 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:47.919810 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e2425208-8b90-4b71-9fdc-57cf40a0f625 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:47.920252 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e2425208-8b90-4b71-9fdc-57cf40a0f625 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:47.943988 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-e2425208-8b90-4b71-9fdc-57cf40a0f625 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lazy-loading 'flavor' on Instance uuid 1d4bc012-5129-4651-97ea-340f735e5e53 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:39:48.017668 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e2425208-8b90-4b71-9fdc-57cf40a0f625 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "POST /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53/action" status: 202 len: 0 microversion: 2.1 time: 0.110425 Jul 21 06:39:48.020917 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 592/1176] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:39:47 2022] POST /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:39:48.028405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-5d389470-45b2-4882-9caa-5c6a0823809b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:48.029249 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-5d389470-45b2-4882-9caa-5c6a0823809b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:48.037059 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5d389470-45b2-4882-9caa-5c6a0823809b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:48.037592 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5d389470-45b2-4882-9caa-5c6a0823809b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:48.039148 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5d389470-45b2-4882-9caa-5c6a0823809b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:48.040004 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-5d389470-45b2-4882-9caa-5c6a0823809b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:48.187605 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-5d389470-45b2-4882-9caa-5c6a0823809b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:48.195091 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-5d389470-45b2-4882-9caa-5c6a0823809b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.172553 Jul 21 06:39:48.195673 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 585/1177] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:48 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:49.213888 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6c0350f1-a448-4c65-b8c8-b553d1bd18b6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:49.214566 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6c0350f1-a448-4c65-b8c8-b553d1bd18b6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:49.222824 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6c0350f1-a448-4c65-b8c8-b553d1bd18b6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:49.223302 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6c0350f1-a448-4c65-b8c8-b553d1bd18b6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:49.224080 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6c0350f1-a448-4c65-b8c8-b553d1bd18b6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:49.224517 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6c0350f1-a448-4c65-b8c8-b553d1bd18b6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:49.364993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-6c0350f1-a448-4c65-b8c8-b553d1bd18b6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:49.375204 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6c0350f1-a448-4c65-b8c8-b553d1bd18b6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.165525 Jul 21 06:39:49.375790 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 593/1178] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:49 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:50.392599 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-13e86ce0-a309-40db-ba6c-403ac6710783 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:50.393144 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-13e86ce0-a309-40db-ba6c-403ac6710783 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:50.400283 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13e86ce0-a309-40db-ba6c-403ac6710783 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:50.400729 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13e86ce0-a309-40db-ba6c-403ac6710783 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:50.401498 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13e86ce0-a309-40db-ba6c-403ac6710783 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:50.401982 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13e86ce0-a309-40db-ba6c-403ac6710783 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:50.541317 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-13e86ce0-a309-40db-ba6c-403ac6710783 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:50.549058 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-13e86ce0-a309-40db-ba6c-403ac6710783 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.160460 Jul 21 06:39:50.549677 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 586/1179] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:50 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:51.566966 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-fb6fe3f2-cdc4-4d16-aa5e-ddcc47f719d7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:51.567640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-fb6fe3f2-cdc4-4d16-aa5e-ddcc47f719d7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:51.575033 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fb6fe3f2-cdc4-4d16-aa5e-ddcc47f719d7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:51.575485 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fb6fe3f2-cdc4-4d16-aa5e-ddcc47f719d7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:51.576257 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fb6fe3f2-cdc4-4d16-aa5e-ddcc47f719d7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:51.576703 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fb6fe3f2-cdc4-4d16-aa5e-ddcc47f719d7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:51.710277 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fb6fe3f2-cdc4-4d16-aa5e-ddcc47f719d7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:51.718318 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-fb6fe3f2-cdc4-4d16-aa5e-ddcc47f719d7 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.155250 Jul 21 06:39:51.718898 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 594/1180] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:51 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:52.736030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-d986374b-44c4-4deb-a2c4-36a01e820c96 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:52.736674 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-d986374b-44c4-4deb-a2c4-36a01e820c96 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:52.743242 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d986374b-44c4-4deb-a2c4-36a01e820c96 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:52.743710 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d986374b-44c4-4deb-a2c4-36a01e820c96 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:52.744459 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d986374b-44c4-4deb-a2c4-36a01e820c96 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:52.745456 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-d986374b-44c4-4deb-a2c4-36a01e820c96 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:52.878504 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-d986374b-44c4-4deb-a2c4-36a01e820c96 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:52.886826 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-d986374b-44c4-4deb-a2c4-36a01e820c96 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.154883 Jul 21 06:39:52.887393 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 587/1181] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:52 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:53.904000 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ca593fe1-661a-4444-aa7a-bbc0c1674149 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:53.904607 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ca593fe1-661a-4444-aa7a-bbc0c1674149 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:53.911200 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca593fe1-661a-4444-aa7a-bbc0c1674149 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:53.911655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca593fe1-661a-4444-aa7a-bbc0c1674149 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:53.912388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca593fe1-661a-4444-aa7a-bbc0c1674149 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:53.912820 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ca593fe1-661a-4444-aa7a-bbc0c1674149 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:54.044305 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-ca593fe1-661a-4444-aa7a-bbc0c1674149 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:54.052044 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ca593fe1-661a-4444-aa7a-bbc0c1674149 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.152996 Jul 21 06:39:54.052810 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 595/1182] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:53 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:55.069813 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-371f4be4-2c9f-4c2b-a11d-eab3317a6465 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:55.070457 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-371f4be4-2c9f-4c2b-a11d-eab3317a6465 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:55.076768 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-371f4be4-2c9f-4c2b-a11d-eab3317a6465 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:55.077219 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-371f4be4-2c9f-4c2b-a11d-eab3317a6465 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:55.078010 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-371f4be4-2c9f-4c2b-a11d-eab3317a6465 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:55.078453 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-371f4be4-2c9f-4c2b-a11d-eab3317a6465 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:55.209027 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-371f4be4-2c9f-4c2b-a11d-eab3317a6465 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:55.217357 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-371f4be4-2c9f-4c2b-a11d-eab3317a6465 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.151397 Jul 21 06:39:55.217932 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 588/1183] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:55 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:56.235265 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-87d59a32-42ac-4f5b-bfcb-a376fffb68aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:56.235981 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-87d59a32-42ac-4f5b-bfcb-a376fffb68aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:56.242837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-87d59a32-42ac-4f5b-bfcb-a376fffb68aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:56.243518 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-87d59a32-42ac-4f5b-bfcb-a376fffb68aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:56.244292 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-87d59a32-42ac-4f5b-bfcb-a376fffb68aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:56.244733 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-87d59a32-42ac-4f5b-bfcb-a376fffb68aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:56.373365 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-87d59a32-42ac-4f5b-bfcb-a376fffb68aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:56.380719 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-87d59a32-42ac-4f5b-bfcb-a376fffb68aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.149568 Jul 21 06:39:56.381280 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 596/1184] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:56 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:57.397817 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-13e2ce7a-591f-4b1e-9a13-fc7bc987f2f6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:57.398399 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-13e2ce7a-591f-4b1e-9a13-fc7bc987f2f6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:57.406158 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13e2ce7a-591f-4b1e-9a13-fc7bc987f2f6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:57.406617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13e2ce7a-591f-4b1e-9a13-fc7bc987f2f6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:57.407390 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13e2ce7a-591f-4b1e-9a13-fc7bc987f2f6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:57.407831 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13e2ce7a-591f-4b1e-9a13-fc7bc987f2f6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:57.545237 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-13e2ce7a-591f-4b1e-9a13-fc7bc987f2f6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:57.552666 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-13e2ce7a-591f-4b1e-9a13-fc7bc987f2f6 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.158846 Jul 21 06:39:57.553231 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 589/1185] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:57 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:58.569640 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-75204654-8e6f-4179-ad23-c1a02cdd2319 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:58.570187 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-75204654-8e6f-4179-ad23-c1a02cdd2319 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:58.576854 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-75204654-8e6f-4179-ad23-c1a02cdd2319 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:58.577303 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-75204654-8e6f-4179-ad23-c1a02cdd2319 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:58.578109 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-75204654-8e6f-4179-ad23-c1a02cdd2319 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:58.578543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-75204654-8e6f-4179-ad23-c1a02cdd2319 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:58.716596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-75204654-8e6f-4179-ad23-c1a02cdd2319 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:58.724108 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-75204654-8e6f-4179-ad23-c1a02cdd2319 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.158426 Jul 21 06:39:58.724678 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 597/1186] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:58 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:39:59.741750 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-941dec99-98e3-49f7-b282-1cd84ed6d39c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:39:59.742390 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-941dec99-98e3-49f7-b282-1cd84ed6d39c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:39:59.750474 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-941dec99-98e3-49f7-b282-1cd84ed6d39c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:59.750931 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-941dec99-98e3-49f7-b282-1cd84ed6d39c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:59.751745 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-941dec99-98e3-49f7-b282-1cd84ed6d39c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:39:59.752218 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-941dec99-98e3-49f7-b282-1cd84ed6d39c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:39:59.881384 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-941dec99-98e3-49f7-b282-1cd84ed6d39c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:39:59.889555 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-941dec99-98e3-49f7-b282-1cd84ed6d39c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.151660 Jul 21 06:39:59.890164 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 590/1187] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:39:59 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:00.907501 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-67ce0e03-1794-446f-9bb0-8d99ee887a1e tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:00.908221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-67ce0e03-1794-446f-9bb0-8d99ee887a1e tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:00.914672 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-67ce0e03-1794-446f-9bb0-8d99ee887a1e tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:00.915190 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-67ce0e03-1794-446f-9bb0-8d99ee887a1e tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:00.916013 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-67ce0e03-1794-446f-9bb0-8d99ee887a1e tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:00.916519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-67ce0e03-1794-446f-9bb0-8d99ee887a1e tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:01.061692 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-67ce0e03-1794-446f-9bb0-8d99ee887a1e tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:01.069735 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-67ce0e03-1794-446f-9bb0-8d99ee887a1e tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.166777 Jul 21 06:40:01.070267 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 598/1188] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:00 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:02.088052 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c0a67ebf-5cc0-45ac-82e5-cbc4d2fab338 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:02.088674 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c0a67ebf-5cc0-45ac-82e5-cbc4d2fab338 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:02.095735 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c0a67ebf-5cc0-45ac-82e5-cbc4d2fab338 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:02.096191 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c0a67ebf-5cc0-45ac-82e5-cbc4d2fab338 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:02.096974 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c0a67ebf-5cc0-45ac-82e5-cbc4d2fab338 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:02.097416 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c0a67ebf-5cc0-45ac-82e5-cbc4d2fab338 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:02.240825 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-c0a67ebf-5cc0-45ac-82e5-cbc4d2fab338 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:02.250285 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c0a67ebf-5cc0-45ac-82e5-cbc4d2fab338 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1507 microversion: 2.1 time: 0.165811 Jul 21 06:40:02.250939 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 591/1189] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:02 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:40:02.266722 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-ec503cc0-1c90-435f-9fe1-e1a582f7132d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:02.267286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-ec503cc0-1c90-435f-9fe1-e1a582f7132d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:02.273729 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec503cc0-1c90-435f-9fe1-e1a582f7132d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:02.274212 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec503cc0-1c90-435f-9fe1-e1a582f7132d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:02.274963 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec503cc0-1c90-435f-9fe1-e1a582f7132d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:02.275393 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-ec503cc0-1c90-435f-9fe1-e1a582f7132d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:02.350293 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-ec503cc0-1c90-435f-9fe1-e1a582f7132d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "POST /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53/action" status: 202 len: 0 microversion: 2.1 time: 0.087210 Jul 21 06:40:02.350842 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 599/1190] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:40:02 2022] POST /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:40:02.360057 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-74ec8e07-f0b6-4ed7-9910-425145c9860b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:02.361044 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-74ec8e07-f0b6-4ed7-9910-425145c9860b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:02.366777 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-74ec8e07-f0b6-4ed7-9910-425145c9860b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:02.367222 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-74ec8e07-f0b6-4ed7-9910-425145c9860b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:02.367994 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-74ec8e07-f0b6-4ed7-9910-425145c9860b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:02.368499 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-74ec8e07-f0b6-4ed7-9910-425145c9860b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:02.542696 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-74ec8e07-f0b6-4ed7-9910-425145c9860b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:02.550808 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-74ec8e07-f0b6-4ed7-9910-425145c9860b tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1515 microversion: 2.1 time: 0.195634 Jul 21 06:40:02.551597 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 592/1191] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:02 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:03.568858 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c5c2490c-496d-4eac-bf48-248b7c6002ee tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:03.569452 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c5c2490c-496d-4eac-bf48-248b7c6002ee tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:03.575874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5c2490c-496d-4eac-bf48-248b7c6002ee tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:03.576322 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5c2490c-496d-4eac-bf48-248b7c6002ee tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:03.577121 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5c2490c-496d-4eac-bf48-248b7c6002ee tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:03.577561 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c5c2490c-496d-4eac-bf48-248b7c6002ee tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:03.663761 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-af9b26f9-4aa5-4757-8c35-2b7893f018e5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:03.664380 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-af9b26f9-4aa5-4757-8c35-2b7893f018e5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:03.675668 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-af9b26f9-4aa5-4757-8c35-2b7893f018e5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:03.676318 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-af9b26f9-4aa5-4757-8c35-2b7893f018e5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:03.677883 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-af9b26f9-4aa5-4757-8c35-2b7893f018e5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:03.680387 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-af9b26f9-4aa5-4757-8c35-2b7893f018e5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:03.719991 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-af9b26f9-4aa5-4757-8c35-2b7893f018e5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:40:03.737453 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c5c2490c-496d-4eac-bf48-248b7c6002ee tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:03.748085 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c5c2490c-496d-4eac-bf48-248b7c6002ee tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1517 microversion: 2.1 time: 0.183125 Jul 21 06:40:03.748666 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 600/1192] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:03 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:03.755004 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-19894335-fe7d-4407-be79-f4fc9c624829 req-8d7fbb79-8f01-46a2-ac4c-f4d4ce998b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1640afc0-f117-498d-b7aa-c8905ac22c7f", "tag": "079bd124-28ea-4a24-82cf-3ee1ee8d3689"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:03.775909 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-19894335-fe7d-4407-be79-f4fc9c624829 req-8d7fbb79-8f01-46a2-ac4c-f4d4ce998b7f service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:03.776366 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-19894335-fe7d-4407-be79-f4fc9c624829 req-8d7fbb79-8f01-46a2-ac4c-f4d4ce998b7f service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:03.791402 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-19894335-fe7d-4407-be79-f4fc9c624829 req-8d7fbb79-8f01-46a2-ac4c-f4d4ce998b7f service nova] Creating event network-changed:079bd124-28ea-4a24-82cf-3ee1ee8d3689 for instance 1640afc0-f117-498d-b7aa-c8905ac22c7f on hv-cinder-85031 Jul 21 06:40:03.806741 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-19894335-fe7d-4407-be79-f4fc9c624829 req-8d7fbb79-8f01-46a2-ac4c-f4d4ce998b7f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054982 Jul 21 06:40:03.807348 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 601/1193] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:40:03.816735 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-9fe3b333-3991-438e-ab2c-684b9143b674 req-c31c6c02-fa88-4c16-86fc-25f476c4e27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4bc012-5129-4651-97ea-340f735e5e53", "name": "network-vif-unplugged", "status": "completed", "tag": "a91746a4-9dc2-4a55-966c-ce5ac2be362d"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:03.829619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-9fe3b333-3991-438e-ab2c-684b9143b674 req-c31c6c02-fa88-4c16-86fc-25f476c4e27c service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:03.830087 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-9fe3b333-3991-438e-ab2c-684b9143b674 req-c31c6c02-fa88-4c16-86fc-25f476c4e27c service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:03.844271 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.compute.server_external_events [req-9fe3b333-3991-438e-ab2c-684b9143b674 req-c31c6c02-fa88-4c16-86fc-25f476c4e27c service nova] Unable to find a host for instance 1d4bc012-5129-4651-97ea-340f735e5e53. Dropping event network-vif-unplugged {{(pid=117906) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 06:40:03.845557 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-9fe3b333-3991-438e-ab2c-684b9143b674 req-c31c6c02-fa88-4c16-86fc-25f476c4e27c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032853 Jul 21 06:40:03.846543 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 602/1194] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 21 06:40:03.850449 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-af9b26f9-4aa5-4757-8c35-2b7893f018e5 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 204 len: 0 microversion: 2.1 time: 0.190786 Jul 21 06:40:03.853117 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 593/1195] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:40:03 2022] DELETE /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 06:40:03.864730 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4fe7a8f7-746d-4821-a92f-1d402476a278 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:03.865493 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4fe7a8f7-746d-4821-a92f-1d402476a278 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:03.878792 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4fe7a8f7-746d-4821-a92f-1d402476a278 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:03.879244 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4fe7a8f7-746d-4821-a92f-1d402476a278 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:03.881526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4fe7a8f7-746d-4821-a92f-1d402476a278 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:03.881912 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4fe7a8f7-746d-4821-a92f-1d402476a278 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:04.029009 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-4fe7a8f7-746d-4821-a92f-1d402476a278 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:04.037770 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4fe7a8f7-746d-4821-a92f-1d402476a278 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1577 microversion: 2.1 time: 0.180440 Jul 21 06:40:04.038374 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 603/1196] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:03 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:04.769298 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a2a5312f-70bf-45de-954d-c2d7fd436fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:04.772434 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a2a5312f-70bf-45de-954d-c2d7fd436fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:04.779353 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a2a5312f-70bf-45de-954d-c2d7fd436fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:04.780086 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a2a5312f-70bf-45de-954d-c2d7fd436fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:04.782160 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a2a5312f-70bf-45de-954d-c2d7fd436fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:04.782990 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a2a5312f-70bf-45de-954d-c2d7fd436fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:04.844158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-aee39354-8740-4033-b970-d52878461a82 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:04.845901 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-aee39354-8740-4033-b970-d52878461a82 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:04.856335 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aee39354-8740-4033-b970-d52878461a82 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:04.857034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aee39354-8740-4033-b970-d52878461a82 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:04.858059 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aee39354-8740-4033-b970-d52878461a82 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:04.859039 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aee39354-8740-4033-b970-d52878461a82 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:04.938455 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a2a5312f-70bf-45de-954d-c2d7fd436fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:04.947712 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a2a5312f-70bf-45de-954d-c2d7fd436fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1517 microversion: 2.1 time: 0.183455 Jul 21 06:40:04.948394 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 594/1197] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:04 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:04.969299 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-aee39354-8740-4033-b970-d52878461a82 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "POST /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/action" status: 202 len: 0 microversion: 2.1 time: 0.131887 Jul 21 06:40:04.973091 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 604/1198] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:40:04 2022] POST /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:40:04.978407 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-f7b7da0f-a347-4d37-a353-16b8263a357a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:04.979200 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-f7b7da0f-a347-4d37-a353-16b8263a357a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:04.985658 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f7b7da0f-a347-4d37-a353-16b8263a357a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:04.986168 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f7b7da0f-a347-4d37-a353-16b8263a357a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:04.986976 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f7b7da0f-a347-4d37-a353-16b8263a357a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:04.987427 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-f7b7da0f-a347-4d37-a353-16b8263a357a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:05.058658 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f926a707-6e5f-4769-b8c7-f25e876ee32d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:05.060475 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f926a707-6e5f-4769-b8c7-f25e876ee32d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:05.067772 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f926a707-6e5f-4769-b8c7-f25e876ee32d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:05.068248 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f926a707-6e5f-4769-b8c7-f25e876ee32d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:05.069224 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f926a707-6e5f-4769-b8c7-f25e876ee32d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:05.069660 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f926a707-6e5f-4769-b8c7-f25e876ee32d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:05.119496 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:40:05.214145 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-f7b7da0f-a347-4d37-a353-16b8263a357a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:05.224437 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-f7b7da0f-a347-4d37-a353-16b8263a357a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1753 microversion: 2.1 time: 0.249708 Jul 21 06:40:05.225178 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 595/1199] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:04 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1753 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:05.277796 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f926a707-6e5f-4769-b8c7-f25e876ee32d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:05.285456 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f926a707-6e5f-4769-b8c7-f25e876ee32d tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1577 microversion: 2.1 time: 0.232889 Jul 21 06:40:05.286205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 605/1200] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:05 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:40:05.967414 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9dcb053b-02e3-42d7-9275-b82baa971bf8 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:05.968545 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9dcb053b-02e3-42d7-9275-b82baa971bf8 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:05.975011 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9dcb053b-02e3-42d7-9275-b82baa971bf8 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:05.975460 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9dcb053b-02e3-42d7-9275-b82baa971bf8 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:05.976217 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9dcb053b-02e3-42d7-9275-b82baa971bf8 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:05.976655 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9dcb053b-02e3-42d7-9275-b82baa971bf8 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:06.238570 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9dcb053b-02e3-42d7-9275-b82baa971bf8 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:06.244269 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-8d70a794-8f6f-40fd-a59c-940cd4a25e10 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:06.246788 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-8d70a794-8f6f-40fd-a59c-940cd4a25e10 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:06.262081 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9dcb053b-02e3-42d7-9275-b82baa971bf8 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.298345 Jul 21 06:40:06.262941 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 596/1201] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:05 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:06.272388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d70a794-8f6f-40fd-a59c-940cd4a25e10 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:06.272388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d70a794-8f6f-40fd-a59c-940cd4a25e10 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:06.272388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d70a794-8f6f-40fd-a59c-940cd4a25e10 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:06.272388 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-8d70a794-8f6f-40fd-a59c-940cd4a25e10 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:06.303995 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-b1881ddf-48c9-4c99-a59d-4246f42cf1f0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:06.305157 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-b1881ddf-48c9-4c99-a59d-4246f42cf1f0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:06.313217 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1881ddf-48c9-4c99-a59d-4246f42cf1f0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:06.314032 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1881ddf-48c9-4c99-a59d-4246f42cf1f0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:06.314899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1881ddf-48c9-4c99-a59d-4246f42cf1f0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:06.315705 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-b1881ddf-48c9-4c99-a59d-4246f42cf1f0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:06.331581 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:40:06.576247 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-8d70a794-8f6f-40fd-a59c-940cd4a25e10 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:06.587389 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-8d70a794-8f6f-40fd-a59c-940cd4a25e10 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1753 microversion: 2.1 time: 0.348003 Jul 21 06:40:06.598517 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 606/1202] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:06 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1753 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:06.603516 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-b1881ddf-48c9-4c99-a59d-4246f42cf1f0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:06.611728 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-b1881ddf-48c9-4c99-a59d-4246f42cf1f0 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1458 microversion: 2.1 time: 0.312994 Jul 21 06:40:06.612402 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 597/1203] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:06 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1458 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:40:06.776346 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-23f8d057-0778-4526-bae3-06be5be71293 req-3092acb6-a653-430b-bc93-2d1c4e16f442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1640afc0-f117-498d-b7aa-c8905ac22c7f", "name": "network-vif-deleted", "tag": "079bd124-28ea-4a24-82cf-3ee1ee8d3689"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:06.785887 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-23f8d057-0778-4526-bae3-06be5be71293 req-3092acb6-a653-430b-bc93-2d1c4e16f442 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:06.786649 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-23f8d057-0778-4526-bae3-06be5be71293 req-3092acb6-a653-430b-bc93-2d1c4e16f442 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:06.800287 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-23f8d057-0778-4526-bae3-06be5be71293 req-3092acb6-a653-430b-bc93-2d1c4e16f442 service nova] Creating event network-vif-deleted:079bd124-28ea-4a24-82cf-3ee1ee8d3689 for instance 1640afc0-f117-498d-b7aa-c8905ac22c7f on hv-cinder-85031 Jul 21 06:40:06.804804 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-23f8d057-0778-4526-bae3-06be5be71293 req-3092acb6-a653-430b-bc93-2d1c4e16f442 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032169 Jul 21 06:40:06.805709 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 607/1204] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:40:07.279214 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-7ef412dc-5b75-4672-a37b-6a103153efc9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:07.279826 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-7ef412dc-5b75-4672-a37b-6a103153efc9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:07.286864 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7ef412dc-5b75-4672-a37b-6a103153efc9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:07.287313 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7ef412dc-5b75-4672-a37b-6a103153efc9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:07.288077 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7ef412dc-5b75-4672-a37b-6a103153efc9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:07.288518 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-7ef412dc-5b75-4672-a37b-6a103153efc9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:07.419488 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-7ef412dc-5b75-4672-a37b-6a103153efc9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:07.427793 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-7ef412dc-5b75-4672-a37b-6a103153efc9 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.152467 Jul 21 06:40:07.428367 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 598/1205] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:07 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:07.605565 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-30a6712a-1705-4a20-aa69-b1899278a99b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:07.606193 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-30a6712a-1705-4a20-aa69-b1899278a99b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:07.612949 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-30a6712a-1705-4a20-aa69-b1899278a99b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:07.613397 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-30a6712a-1705-4a20-aa69-b1899278a99b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:07.614188 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-30a6712a-1705-4a20-aa69-b1899278a99b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:07.614624 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-30a6712a-1705-4a20-aa69-b1899278a99b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:07.628771 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:07.629386 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:07.635293 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:07.635747 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:07.636513 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:07.636954 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:07.682368 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:07.683172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:07.683982 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lazy-loading 'fault' on Instance uuid 1640afc0-f117-498d-b7aa-c8905ac22c7f {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:40:07.739230 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:07.746846 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-86a713f0-9b8c-4296-bee5-287d854b9803 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 200 len: 1230 microversion: 2.1 time: 0.122019 Jul 21 06:40:07.747371 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 599/1206] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:07 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 1230 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:40:07.797896 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-30a6712a-1705-4a20-aa69-b1899278a99b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:07.805935 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-30a6712a-1705-4a20-aa69-b1899278a99b tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1758 microversion: 2.1 time: 0.205109 Jul 21 06:40:07.806527 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 608/1207] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:07 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:08.444690 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-13ad7391-58d9-4db9-86ee-4f4bcac33dd5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:08.445308 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-13ad7391-58d9-4db9-86ee-4f4bcac33dd5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:08.447577 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:40:08.453392 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13ad7391-58d9-4db9-86ee-4f4bcac33dd5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:08.453836 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13ad7391-58d9-4db9-86ee-4f4bcac33dd5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:08.454629 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13ad7391-58d9-4db9-86ee-4f4bcac33dd5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:08.455088 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-13ad7391-58d9-4db9-86ee-4f4bcac33dd5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:08.585138 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-13ad7391-58d9-4db9-86ee-4f4bcac33dd5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:08.592617 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-13ad7391-58d9-4db9-86ee-4f4bcac33dd5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.151766 Jul 21 06:40:08.593320 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 600/1208] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:08 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:08.762994 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-67cdfcae-287e-4c9a-8614-ea2a5005c5ba tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:08.763603 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-67cdfcae-287e-4c9a-8614-ea2a5005c5ba tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 1640afc0-f117-498d-b7aa-c8905ac22c7f] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:08.769960 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-67cdfcae-287e-4c9a-8614-ea2a5005c5ba tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:08.770424 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-67cdfcae-287e-4c9a-8614-ea2a5005c5ba tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:08.771180 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-67cdfcae-287e-4c9a-8614-ea2a5005c5ba tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:08.771639 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-67cdfcae-287e-4c9a-8614-ea2a5005c5ba tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:08.785164 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-67cdfcae-287e-4c9a-8614-ea2a5005c5ba tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] HTTP exception thrown: Instance 1640afc0-f117-498d-b7aa-c8905ac22c7f could not be found. Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-67cdfcae-287e-4c9a-8614-ea2a5005c5ba tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Request method failure captured: Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f HTTP/1.1 Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PLm9tyySK3qJdzYT6hnN2CdZPsJRJ_srIoWVYVHjPBG5rb1xeBaPlAmOzFhEGU5qwtncWPLsnEJTD8pTLqWTI0xbRFigUga3R9RzBdl5uQ_pk_gVWvAtA82phdiMS8zDSEsu3Ch2ovjw4IimaPa2loVLkelL01NSiAylyZiNKZVd_E Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 5d0ba27e9a7f450c87eb189cdd6e235b Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:40:08.786798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d0ba27e9a7f450c87eb189cdd6e235b"}]}] Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 5d0ba27e9a7f450c87eb189cdd6e235b Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-TestVolumeBootPattern-1839744956-project Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5439d1a65154486bb4fdfeeaf8ab4b07 Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-TestVolumeBootPattern-1839744956-project Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 1640afc0-f117-498d-b7aa-c8905ac22c7f could not be found. Jul 21 06:40:08.788526 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '1640afc0-f117-498d-b7aa-c8905ac22c7f'} Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1640afc0-f117-498d-b7aa-c8905ac22c7f could not be found. Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:40:08.789593 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1640afc0-f117-498d-b7aa-c8905ac22c7f could not be found. Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1640afc0-f117-498d-b7aa-c8905ac22c7f could not be found. Jul 21 06:40:08.791331 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:08.792978 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-67cdfcae-287e-4c9a-8614-ea2a5005c5ba tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Returning 404 to user: Instance 1640afc0-f117-498d-b7aa-c8905ac22c7f could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:40:08.792978 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-67cdfcae-287e-4c9a-8614-ea2a5005c5ba tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f" status: 404 len: 111 microversion: 2.1 time: 0.029122 Jul 21 06:40:08.792978 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 609/1209] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:08 2022] GET /compute/v2.1/servers/1640afc0-f117-498d-b7aa-c8905ac22c7f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:40:08.823121 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-ab841d2c-b817-42d8-b1b4-b6a84a37e0ae tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:08.823748 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-ab841d2c-b817-42d8-b1b4-b6a84a37e0ae tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:08.830030 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ab841d2c-b817-42d8-b1b4-b6a84a37e0ae tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:08.830415 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ab841d2c-b817-42d8-b1b4-b6a84a37e0ae tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:08.831203 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ab841d2c-b817-42d8-b1b4-b6a84a37e0ae tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:08.831650 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-ab841d2c-b817-42d8-b1b4-b6a84a37e0ae tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:08.986194 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-ab841d2c-b817-42d8-b1b4-b6a84a37e0ae tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:08.994293 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-ab841d2c-b817-42d8-b1b4-b6a84a37e0ae tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1758 microversion: 2.1 time: 0.174886 Jul 21 06:40:08.994858 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 601/1210] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:08 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:09.609866 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-fc9839ca-dbed-478b-a33b-26003dbb890d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:09.610498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-fc9839ca-dbed-478b-a33b-26003dbb890d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:09.616651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fc9839ca-dbed-478b-a33b-26003dbb890d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:09.617108 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fc9839ca-dbed-478b-a33b-26003dbb890d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:09.617881 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fc9839ca-dbed-478b-a33b-26003dbb890d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:09.618344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fc9839ca-dbed-478b-a33b-26003dbb890d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:09.746255 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fc9839ca-dbed-478b-a33b-26003dbb890d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:09.754299 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-fc9839ca-dbed-478b-a33b-26003dbb890d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.148228 Jul 21 06:40:09.754868 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 610/1211] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:09 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:10.010766 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9c888154-333a-45f2-ac0d-59f6e42f81d7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:10.011408 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9c888154-333a-45f2-ac0d-59f6e42f81d7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:10.018006 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c888154-333a-45f2-ac0d-59f6e42f81d7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:10.018486 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c888154-333a-45f2-ac0d-59f6e42f81d7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:10.019224 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c888154-333a-45f2-ac0d-59f6e42f81d7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:10.019662 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9c888154-333a-45f2-ac0d-59f6e42f81d7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:10.164796 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9c888154-333a-45f2-ac0d-59f6e42f81d7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:10.173299 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9c888154-333a-45f2-ac0d-59f6e42f81d7 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1758 microversion: 2.1 time: 0.166302 Jul 21 06:40:10.173862 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 602/1212] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:10 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:10.772001 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-83da8fa8-2830-42e2-8362-9e137abc4ddd tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:10.772600 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-83da8fa8-2830-42e2-8362-9e137abc4ddd tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:10.778987 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-83da8fa8-2830-42e2-8362-9e137abc4ddd tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:10.779437 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-83da8fa8-2830-42e2-8362-9e137abc4ddd tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:10.780199 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-83da8fa8-2830-42e2-8362-9e137abc4ddd tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:10.781519 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-83da8fa8-2830-42e2-8362-9e137abc4ddd tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:10.912363 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-83da8fa8-2830-42e2-8362-9e137abc4ddd tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:10.919837 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-83da8fa8-2830-42e2-8362-9e137abc4ddd tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.151765 Jul 21 06:40:10.920398 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 611/1213] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:10 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:11.190897 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-413e2ecd-3861-4152-b36f-5d5b57e8f80f tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:11.191627 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-413e2ecd-3861-4152-b36f-5d5b57e8f80f tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:11.198180 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-413e2ecd-3861-4152-b36f-5d5b57e8f80f tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:11.198633 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-413e2ecd-3861-4152-b36f-5d5b57e8f80f tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:11.199396 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-413e2ecd-3861-4152-b36f-5d5b57e8f80f tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:11.199834 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-413e2ecd-3861-4152-b36f-5d5b57e8f80f tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:11.434217 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-413e2ecd-3861-4152-b36f-5d5b57e8f80f tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:11.441970 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-413e2ecd-3861-4152-b36f-5d5b57e8f80f tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1758 microversion: 2.1 time: 0.254975 Jul 21 06:40:11.442561 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 603/1214] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:11 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1758 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:11.939029 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-cb404728-2adb-49c0-8a23-1caeda943832 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:11.939638 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-cb404728-2adb-49c0-8a23-1caeda943832 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:11.945954 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cb404728-2adb-49c0-8a23-1caeda943832 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:11.946410 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cb404728-2adb-49c0-8a23-1caeda943832 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:11.947164 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cb404728-2adb-49c0-8a23-1caeda943832 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:11.947625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-cb404728-2adb-49c0-8a23-1caeda943832 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:12.162586 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-cb404728-2adb-49c0-8a23-1caeda943832 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:12.170104 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-cb404728-2adb-49c0-8a23-1caeda943832 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.236062 Jul 21 06:40:12.170682 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 612/1215] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:11 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:12.259675 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-532199c5-120c-439f-8bf2-bbfc840d0143 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:12.260182 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-532199c5-120c-439f-8bf2-bbfc840d0143 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:12.266618 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-94a6263a-43f9-4961-952d-0f1961b0e7c0 req-fc1f6531-0012-4fe2-9721-b95dc1720d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9015b69f-c621-4156-a5c9-94bfc3f3b41c", "tag": "fe87d5c2-e7cb-44a8-bcf1-7d5b938d8647"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:12.266913 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-532199c5-120c-439f-8bf2-bbfc840d0143 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:12.267573 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-532199c5-120c-439f-8bf2-bbfc840d0143 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:12.268378 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-532199c5-120c-439f-8bf2-bbfc840d0143 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:12.268822 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-532199c5-120c-439f-8bf2-bbfc840d0143 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:12.270221 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=48 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:40:12.276921 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-94a6263a-43f9-4961-952d-0f1961b0e7c0 req-fc1f6531-0012-4fe2-9721-b95dc1720d16 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:12.277363 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-94a6263a-43f9-4961-952d-0f1961b0e7c0 req-fc1f6531-0012-4fe2-9721-b95dc1720d16 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:12.290827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-94a6263a-43f9-4961-952d-0f1961b0e7c0 req-fc1f6531-0012-4fe2-9721-b95dc1720d16 service nova] Creating event network-changed:fe87d5c2-e7cb-44a8-bcf1-7d5b938d8647 for instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c on hv-cinder-85031 Jul 21 06:40:12.295944 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-94a6263a-43f9-4961-952d-0f1961b0e7c0 req-fc1f6531-0012-4fe2-9721-b95dc1720d16 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033532 Jul 21 06:40:12.298326 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 613/1216] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:40:12.303877 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-532199c5-120c-439f-8bf2-bbfc840d0143 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:40:12.391405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-532199c5-120c-439f-8bf2-bbfc840d0143 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 204 len: 0 microversion: 2.1 time: 0.135335 Jul 21 06:40:12.392061 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 604/1217] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:40:12 2022] DELETE /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:40:12.401274 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-153f731f-07b8-4881-86cc-e373aa061bfa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:12.401993 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-153f731f-07b8-4881-86cc-e373aa061bfa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:12.408775 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-153f731f-07b8-4881-86cc-e373aa061bfa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:12.409242 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-153f731f-07b8-4881-86cc-e373aa061bfa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:12.410115 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-153f731f-07b8-4881-86cc-e373aa061bfa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:12.410494 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-153f731f-07b8-4881-86cc-e373aa061bfa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:12.459459 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-41fd02ca-2291-44f4-8256-9412af02e98e tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:12.460263 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-41fd02ca-2291-44f4-8256-9412af02e98e tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:12.466916 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41fd02ca-2291-44f4-8256-9412af02e98e tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:12.467455 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41fd02ca-2291-44f4-8256-9412af02e98e tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:12.468351 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41fd02ca-2291-44f4-8256-9412af02e98e tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:12.468945 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41fd02ca-2291-44f4-8256-9412af02e98e tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:12.558090 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-153f731f-07b8-4881-86cc-e373aa061bfa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:12.568827 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-153f731f-07b8-4881-86cc-e373aa061bfa tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1578 microversion: 2.1 time: 0.171665 Jul 21 06:40:12.569716 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 614/1218] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:12 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:12.804371 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-41fd02ca-2291-44f4-8256-9412af02e98e tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:12.813053 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-41fd02ca-2291-44f4-8256-9412af02e98e tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1758 microversion: 2.1 time: 0.358043 Jul 21 06:40:12.813640 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 605/1219] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:12 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1758 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:40:13.188804 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-5146c2ef-f7ef-4297-84af-94b1b780fda4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:13.189528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-5146c2ef-f7ef-4297-84af-94b1b780fda4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:13.196595 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5146c2ef-f7ef-4297-84af-94b1b780fda4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:13.196980 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5146c2ef-f7ef-4297-84af-94b1b780fda4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:13.197781 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5146c2ef-f7ef-4297-84af-94b1b780fda4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:13.198240 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-5146c2ef-f7ef-4297-84af-94b1b780fda4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:13.334047 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-5146c2ef-f7ef-4297-84af-94b1b780fda4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:13.341122 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-5146c2ef-f7ef-4297-84af-94b1b780fda4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.156494 Jul 21 06:40:13.341684 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 615/1220] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:13 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:13.586339 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-50c90999-b7da-4b12-a6ca-806978356aac tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:13.586951 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-50c90999-b7da-4b12-a6ca-806978356aac tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:13.593834 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50c90999-b7da-4b12-a6ca-806978356aac tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:13.594321 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50c90999-b7da-4b12-a6ca-806978356aac tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:13.595086 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50c90999-b7da-4b12-a6ca-806978356aac tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:13.595522 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-50c90999-b7da-4b12-a6ca-806978356aac tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:13.729131 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-50c90999-b7da-4b12-a6ca-806978356aac tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:13.737823 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-50c90999-b7da-4b12-a6ca-806978356aac tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1578 microversion: 2.1 time: 0.155350 Jul 21 06:40:13.738430 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 606/1221] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:13 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:13.829972 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-c42d8f0d-485e-40b4-95fc-c8b8e0b2e6d5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:13.830609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-c42d8f0d-485e-40b4-95fc-c8b8e0b2e6d5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:13.836795 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c42d8f0d-485e-40b4-95fc-c8b8e0b2e6d5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:13.837186 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c42d8f0d-485e-40b4-95fc-c8b8e0b2e6d5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:13.838001 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c42d8f0d-485e-40b4-95fc-c8b8e0b2e6d5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:13.838445 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-c42d8f0d-485e-40b4-95fc-c8b8e0b2e6d5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:13.978790 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-c42d8f0d-485e-40b4-95fc-c8b8e0b2e6d5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:13.987184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-c42d8f0d-485e-40b4-95fc-c8b8e0b2e6d5 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1758 microversion: 2.1 time: 0.161196 Jul 21 06:40:13.987755 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 616/1222] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:13 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:14.358529 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-9967cb7c-659a-4ed4-8108-5a6248230ad4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:14.359998 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-9967cb7c-659a-4ed4-8108-5a6248230ad4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:14.366126 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9967cb7c-659a-4ed4-8108-5a6248230ad4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:14.366580 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9967cb7c-659a-4ed4-8108-5a6248230ad4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:14.367343 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9967cb7c-659a-4ed4-8108-5a6248230ad4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:14.367780 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-9967cb7c-659a-4ed4-8108-5a6248230ad4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:14.504723 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-9967cb7c-659a-4ed4-8108-5a6248230ad4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:14.512443 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-9967cb7c-659a-4ed4-8108-5a6248230ad4 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.157768 Jul 21 06:40:14.513021 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 607/1223] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:14 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:14.754968 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-fb071abf-31e2-4b93-915f-97f7d2676f63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:14.755723 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-fb071abf-31e2-4b93-915f-97f7d2676f63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:14.762462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fb071abf-31e2-4b93-915f-97f7d2676f63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:14.762916 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fb071abf-31e2-4b93-915f-97f7d2676f63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:14.763689 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fb071abf-31e2-4b93-915f-97f7d2676f63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:14.764147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-fb071abf-31e2-4b93-915f-97f7d2676f63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:14.899270 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-fb071abf-31e2-4b93-915f-97f7d2676f63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:14.907018 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-fb071abf-31e2-4b93-915f-97f7d2676f63 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1578 microversion: 2.1 time: 0.155854 Jul 21 06:40:14.907659 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 617/1224] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:14 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:40:15.004806 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-8851f8c3-bae8-4dc5-802d-769447884ac0 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:15.005362 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-8851f8c3-bae8-4dc5-802d-769447884ac0 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:15.011705 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8851f8c3-bae8-4dc5-802d-769447884ac0 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:15.012151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8851f8c3-bae8-4dc5-802d-769447884ac0 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:15.012912 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8851f8c3-bae8-4dc5-802d-769447884ac0 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:15.013346 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-8851f8c3-bae8-4dc5-802d-769447884ac0 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:15.148442 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-4855fe67-0784-44ad-b07b-a0b850f73bd9 req-bdb4fc24-f077-4b06-9912-4eccf6d79422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9015b69f-c621-4156-a5c9-94bfc3f3b41c", "name": "network-vif-deleted", "tag": "fe87d5c2-e7cb-44a8-bcf1-7d5b938d8647"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:15.158691 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-4855fe67-0784-44ad-b07b-a0b850f73bd9 req-bdb4fc24-f077-4b06-9912-4eccf6d79422 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:15.159132 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-4855fe67-0784-44ad-b07b-a0b850f73bd9 req-bdb4fc24-f077-4b06-9912-4eccf6d79422 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:15.170642 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-4855fe67-0784-44ad-b07b-a0b850f73bd9 req-bdb4fc24-f077-4b06-9912-4eccf6d79422 service nova] Creating event network-vif-deleted:fe87d5c2-e7cb-44a8-bcf1-7d5b938d8647 for instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c on hv-cinder-85031 Jul 21 06:40:15.171872 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-8851f8c3-bae8-4dc5-802d-769447884ac0 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:15.176414 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-4855fe67-0784-44ad-b07b-a0b850f73bd9 req-bdb4fc24-f077-4b06-9912-4eccf6d79422 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031575 Jul 21 06:40:15.177462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 618/1225] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:40:15.181220 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-8851f8c3-bae8-4dc5-802d-769447884ac0 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1758 microversion: 2.1 time: 0.180171 Jul 21 06:40:15.181825 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 608/1226] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:14 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:15.530537 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-75798cfc-d08b-4e86-b3b8-48075823c4fb tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:15.533178 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-75798cfc-d08b-4e86-b3b8-48075823c4fb tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:15.539762 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-75798cfc-d08b-4e86-b3b8-48075823c4fb tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:15.540219 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-75798cfc-d08b-4e86-b3b8-48075823c4fb tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:15.541038 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-75798cfc-d08b-4e86-b3b8-48075823c4fb tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:15.541515 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-75798cfc-d08b-4e86-b3b8-48075823c4fb tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:15.683507 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-75798cfc-d08b-4e86-b3b8-48075823c4fb tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:15.691627 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-75798cfc-d08b-4e86-b3b8-48075823c4fb tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.165715 Jul 21 06:40:15.692204 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 619/1227] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:15 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:40:15.926372 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:15.927124 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:15.933841 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:15.934333 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:15.935103 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:15.935536 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:15.972213 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:15.972662 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:15.973113 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.objects.instance [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lazy-loading 'fault' on Instance uuid 9015b69f-c621-4156-a5c9-94bfc3f3b41c {{(pid=117905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:40:16.022791 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439d1a65154486bb4fdfeeaf8ab4b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0ba27e9a7f450c87eb189cdd6e235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:16.030188 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2aff3982-a86c-435d-be65-0fe46222aebb tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 200 len: 1185 microversion: 2.1 time: 0.109990 Jul 21 06:40:16.031309 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 609/1228] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:15 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 1185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:16.199306 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-93ded466-be3b-4bee-bed5-57fc3f4dc450 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:16.199948 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-93ded466-be3b-4bee-bed5-57fc3f4dc450 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:16.207101 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-93ded466-be3b-4bee-bed5-57fc3f4dc450 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:16.207553 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-93ded466-be3b-4bee-bed5-57fc3f4dc450 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:16.208326 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-93ded466-be3b-4bee-bed5-57fc3f4dc450 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:16.208764 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-93ded466-be3b-4bee-bed5-57fc3f4dc450 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:16.371596 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-93ded466-be3b-4bee-bed5-57fc3f4dc450 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:16.379798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-93ded466-be3b-4bee-bed5-57fc3f4dc450 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1758 microversion: 2.1 time: 0.184422 Jul 21 06:40:16.380376 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 620/1229] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:16 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:16.709719 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-27d1b59a-5b5e-42a4-b728-f188f985daa3 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:16.710271 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-27d1b59a-5b5e-42a4-b728-f188f985daa3 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:16.716310 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-27d1b59a-5b5e-42a4-b728-f188f985daa3 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:16.716760 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-27d1b59a-5b5e-42a4-b728-f188f985daa3 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:16.717524 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-27d1b59a-5b5e-42a4-b728-f188f985daa3 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:16.717991 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-27d1b59a-5b5e-42a4-b728-f188f985daa3 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:16.849159 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-27d1b59a-5b5e-42a4-b728-f188f985daa3 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:16.856821 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-27d1b59a-5b5e-42a4-b728-f188f985daa3 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.151066 Jul 21 06:40:16.857429 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 610/1230] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:16 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:17.048342 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6d3bc5e0-2fce-4289-89f7-d434be7974f6 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:17.048952 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-6d3bc5e0-2fce-4289-89f7-d434be7974f6 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 9015b69f-c621-4156-a5c9-94bfc3f3b41c] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:17.055046 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6d3bc5e0-2fce-4289-89f7-d434be7974f6 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:17.055492 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6d3bc5e0-2fce-4289-89f7-d434be7974f6 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:17.056253 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6d3bc5e0-2fce-4289-89f7-d434be7974f6 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:17.056982 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-6d3bc5e0-2fce-4289-89f7-d434be7974f6 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:17.070417 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-6d3bc5e0-2fce-4289-89f7-d434be7974f6 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] HTTP exception thrown: Instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c could not be found. Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6d3bc5e0-2fce-4289-89f7-d434be7974f6 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Request method failure captured: Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c HTTP/1.1 Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PLm9tyySK3qJdzYT6hnN2CdZPsJRJ_srIoWVYVHjPBG5rb1xeBaPlAmOzFhEGU5qwtncWPLsnEJTD8pTLqWTI0xbRFigUga3R9RzBdl5uQ_pk_gVWvAtA82phdiMS8zDSEsu3Ch2ovjw4IimaPa2loVLkelL01NSiAylyZiNKZVd_E Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 5d0ba27e9a7f450c87eb189cdd6e235b Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:40:17.072034 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d0ba27e9a7f450c87eb189cdd6e235b"}]}] Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 5d0ba27e9a7f450c87eb189cdd6e235b Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-TestVolumeBootPattern-1839744956-project Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5439d1a65154486bb4fdfeeaf8ab4b07 Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-TestVolumeBootPattern-1839744956-project Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c could not be found. Jul 21 06:40:17.073625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '9015b69f-c621-4156-a5c9-94bfc3f3b41c'} Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c could not be found. Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:40:17.074520 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c could not be found. Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c could not be found. Jul 21 06:40:17.075876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.077111 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-6d3bc5e0-2fce-4289-89f7-d434be7974f6 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Returning 404 to user: Instance 9015b69f-c621-4156-a5c9-94bfc3f3b41c could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:40:17.077111 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-6d3bc5e0-2fce-4289-89f7-d434be7974f6 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c" status: 404 len: 111 microversion: 2.1 time: 0.028957 Jul 21 06:40:17.077111 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 621/1231] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:17 2022] GET /compute/v2.1/servers/9015b69f-c621-4156-a5c9-94bfc3f3b41c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:40:17.396932 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-1c0ad130-4022-4749-b0ec-a182cad32df8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:17.397508 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-1c0ad130-4022-4749-b0ec-a182cad32df8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:17.403798 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1c0ad130-4022-4749-b0ec-a182cad32df8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:17.404245 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1c0ad130-4022-4749-b0ec-a182cad32df8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:17.405006 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1c0ad130-4022-4749-b0ec-a182cad32df8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:17.405441 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-1c0ad130-4022-4749-b0ec-a182cad32df8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:17.519860 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-601a0d4b-4a39-4b5c-8442-f846f915b5af tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:17.520423 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-601a0d4b-4a39-4b5c-8442-f846f915b5af tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:17.526923 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-601a0d4b-4a39-4b5c-8442-f846f915b5af tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:17.527440 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-601a0d4b-4a39-4b5c-8442-f846f915b5af tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:17.528286 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-601a0d4b-4a39-4b5c-8442-f846f915b5af tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:17.528782 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-601a0d4b-4a39-4b5c-8442-f846f915b5af tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:17.543003 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-601a0d4b-4a39-4b5c-8442-f846f915b5af tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] HTTP exception thrown: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-601a0d4b-4a39-4b5c-8442-f846f915b5af tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Request method failure captured: Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 HTTP/1.1 Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PLm9tyySK3qJdzYT6hnN2CdZPsJRJ_srIoWVYVHjPBG5rb1xeBaPlAmOzFhEGU5qwtncWPLsnEJTD8pTLqWTI0xbRFigUga3R9RzBdl5uQ_pk_gVWvAtA82phdiMS8zDSEsu3Ch2ovjw4IimaPa2loVLkelL01NSiAylyZiNKZVd_E Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 5d0ba27e9a7f450c87eb189cdd6e235b Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:40:17.544498 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d0ba27e9a7f450c87eb189cdd6e235b"}]}] Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 5d0ba27e9a7f450c87eb189cdd6e235b Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-TestVolumeBootPattern-1839744956-project Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5439d1a65154486bb4fdfeeaf8ab4b07 Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-TestVolumeBootPattern-1839744956-project Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:40:17.546197 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '3dd12a96-a6ba-4881-9e69-20771a9b2d91'} Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:40:17.547743 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:40:17.549715 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.551492 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-601a0d4b-4a39-4b5c-8442-f846f915b5af tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Returning 404 to user: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:40:17.551492 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-601a0d4b-4a39-4b5c-8442-f846f915b5af tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 404 len: 111 microversion: 2.1 time: 0.029915 Jul 21 06:40:17.551492 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 622/1232] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:40:17 2022] DELETE /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 06:40:17.553716 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-1c0ad130-4022-4749-b0ec-a182cad32df8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:17.556077 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a7f75775-ef07-4c2c-93ff-330f57bb34ea tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:17.556217 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:40:17.556836 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-a7f75775-ef07-4c2c-93ff-330f57bb34ea tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] [instance: 3dd12a96-a6ba-4881-9e69-20771a9b2d91] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:17.563798 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a7f75775-ef07-4c2c-93ff-330f57bb34ea tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:17.564339 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a7f75775-ef07-4c2c-93ff-330f57bb34ea tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:17.564887 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-1c0ad130-4022-4749-b0ec-a182cad32df8 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1758 microversion: 2.1 time: 0.171907 Jul 21 06:40:17.565261 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a7f75775-ef07-4c2c-93ff-330f57bb34ea tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:17.565464 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 611/1233] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:17 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:17.565821 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-a7f75775-ef07-4c2c-93ff-330f57bb34ea tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:17.589970 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-a7f75775-ef07-4c2c-93ff-330f57bb34ea tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] HTTP exception thrown: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a7f75775-ef07-4c2c-93ff-330f57bb34ea tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Request method failure captured: Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 HTTP/1.1 Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PLm9tyySK3qJdzYT6hnN2CdZPsJRJ_srIoWVYVHjPBG5rb1xeBaPlAmOzFhEGU5qwtncWPLsnEJTD8pTLqWTI0xbRFigUga3R9RzBdl5uQ_pk_gVWvAtA82phdiMS8zDSEsu3Ch2ovjw4IimaPa2loVLkelL01NSiAylyZiNKZVd_E Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 5d0ba27e9a7f450c87eb189cdd6e235b Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:40:17.591510 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d0ba27e9a7f450c87eb189cdd6e235b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d0ba27e9a7f450c87eb189cdd6e235b"}]}] Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 5d0ba27e9a7f450c87eb189cdd6e235b Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-TestVolumeBootPattern-1839744956 Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-TestVolumeBootPattern-1839744956-project Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 5439d1a65154486bb4fdfeeaf8ab4b07 Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-TestVolumeBootPattern-1839744956-project Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:40:17.593198 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '3dd12a96-a6ba-4881-9e69-20771a9b2d91'} Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:40:17.594158 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. Jul 21 06:40:17.595521 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:17.596805 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-a7f75775-ef07-4c2c-93ff-330f57bb34ea tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Returning 404 to user: Instance 3dd12a96-a6ba-4881-9e69-20771a9b2d91 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:40:17.596805 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-a7f75775-ef07-4c2c-93ff-330f57bb34ea tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91" status: 404 len: 111 microversion: 2.1 time: 0.040594 Jul 21 06:40:17.596805 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 623/1234] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:17 2022] GET /compute/v2.1/servers/3dd12a96-a6ba-4881-9e69-20771a9b2d91 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 06:40:17.875416 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0a56657d-3f72-4d1a-8e61-83f4408ab564 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:17.876130 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0a56657d-3f72-4d1a-8e61-83f4408ab564 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:17.883681 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0a56657d-3f72-4d1a-8e61-83f4408ab564 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:17.884373 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0a56657d-3f72-4d1a-8e61-83f4408ab564 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:17.885294 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0a56657d-3f72-4d1a-8e61-83f4408ab564 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:17.885821 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0a56657d-3f72-4d1a-8e61-83f4408ab564 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:18.037006 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0a56657d-3f72-4d1a-8e61-83f4408ab564 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:18.047984 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0a56657d-3f72-4d1a-8e61-83f4408ab564 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.176343 Jul 21 06:40:18.048571 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 612/1235] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:17 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:18.582581 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-d83d22f5-80dd-47ac-9f3d-a837e1dbdc92 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:18.583195 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-d83d22f5-80dd-47ac-9f3d-a837e1dbdc92 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:18.589632 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d83d22f5-80dd-47ac-9f3d-a837e1dbdc92 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:18.590122 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d83d22f5-80dd-47ac-9f3d-a837e1dbdc92 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:18.590882 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d83d22f5-80dd-47ac-9f3d-a837e1dbdc92 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:18.591317 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-d83d22f5-80dd-47ac-9f3d-a837e1dbdc92 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:18.786822 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-d83d22f5-80dd-47ac-9f3d-a837e1dbdc92 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:18.794745 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-d83d22f5-80dd-47ac-9f3d-a837e1dbdc92 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1761 microversion: 2.1 time: 0.216546 Jul 21 06:40:18.795347 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 624/1236] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:18 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1761 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:18.882495 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-909cacfe-e44c-4e98-83e1-8e0e63c2c730 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] Calling method '.version_select at 0x7f9327e06d30>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:18.901100 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-909cacfe-e44c-4e98-83e1-8e0e63c2c730 tempest-TestVolumeBootPattern-1839744956 tempest-TestVolumeBootPattern-1839744956-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1128193888" status: 202 len: 0 microversion: 2.1 time: 0.022375 Jul 21 06:40:18.901767 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 613/1237] 10.222.0.42 () {58 vars in 1262 bytes} [Thu Jul 21 06:40:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1128193888 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:40:19.065071 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-e478372a-48b8-4a9a-9eaa-06def5e14fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:19.065721 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-e478372a-48b8-4a9a-9eaa-06def5e14fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:19.071813 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e478372a-48b8-4a9a-9eaa-06def5e14fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:19.072266 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e478372a-48b8-4a9a-9eaa-06def5e14fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:19.073033 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e478372a-48b8-4a9a-9eaa-06def5e14fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:19.073477 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-e478372a-48b8-4a9a-9eaa-06def5e14fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:19.311186 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-e478372a-48b8-4a9a-9eaa-06def5e14fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:19.318655 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-e478372a-48b8-4a9a-9eaa-06def5e14fa5 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.257967 Jul 21 06:40:19.319235 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 625/1238] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:19 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:19.867971 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-970a23c1-0970-41d2-a4b0-0e31acf65f9b req-78064d62-22d3-440b-bbea-e9cad2783cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4bc012-5129-4651-97ea-340f735e5e53", "name": "network-vif-plugged", "status": "completed", "tag": "a91746a4-9dc2-4a55-966c-ce5ac2be362d"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:19.876947 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-970a23c1-0970-41d2-a4b0-0e31acf65f9b req-78064d62-22d3-440b-bbea-e9cad2783cba service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:19.877805 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-970a23c1-0970-41d2-a4b0-0e31acf65f9b req-78064d62-22d3-440b-bbea-e9cad2783cba service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:19.891872 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-970a23c1-0970-41d2-a4b0-0e31acf65f9b req-78064d62-22d3-440b-bbea-e9cad2783cba service nova] Creating event network-vif-plugged:a91746a4-9dc2-4a55-966c-ce5ac2be362d for instance 1d4bc012-5129-4651-97ea-340f735e5e53 on hv-cinder-85031 Jul 21 06:40:19.897477 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-970a23c1-0970-41d2-a4b0-0e31acf65f9b req-78064d62-22d3-440b-bbea-e9cad2783cba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033414 Jul 21 06:40:19.898304 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 614/1239] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:40:20.336094 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-f5754ce5-ffe0-4dd6-9a73-ed8c7074a4aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:20.336706 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-f5754ce5-ffe0-4dd6-9a73-ed8c7074a4aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:20.343090 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f5754ce5-ffe0-4dd6-9a73-ed8c7074a4aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:20.344096 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f5754ce5-ffe0-4dd6-9a73-ed8c7074a4aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:20.344958 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f5754ce5-ffe0-4dd6-9a73-ed8c7074a4aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:20.345392 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-f5754ce5-ffe0-4dd6-9a73-ed8c7074a4aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:20.547346 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-f5754ce5-ffe0-4dd6-9a73-ed8c7074a4aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:20.549651 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=100 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:40:20.556211 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-f5754ce5-ffe0-4dd6-9a73-ed8c7074a4aa tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1573 microversion: 2.1 time: 0.223897 Jul 21 06:40:20.557001 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 626/1240] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:20 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1573 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:21.575894 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a61b144e-2ee4-4735-9cad-f480e8ea84f2 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:21.576867 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-a61b144e-2ee4-4735-9cad-f480e8ea84f2 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:21.584409 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a61b144e-2ee4-4735-9cad-f480e8ea84f2 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:21.585504 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a61b144e-2ee4-4735-9cad-f480e8ea84f2 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:21.586401 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a61b144e-2ee4-4735-9cad-f480e8ea84f2 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:21.587070 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-a61b144e-2ee4-4735-9cad-f480e8ea84f2 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:21.733256 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-a61b144e-2ee4-4735-9cad-f480e8ea84f2 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:21.741847 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a61b144e-2ee4-4735-9cad-f480e8ea84f2 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1560 microversion: 2.1 time: 0.170868 Jul 21 06:40:21.742458 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 615/1241] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:21 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:39.061238 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:40:39.061803 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Thu Jul 21 06:40:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:40:51.774441 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-57513abd-3b68-4fec-b98e-df6d23265758 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1817062526"}} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:51.775062 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-57513abd-3b68-4fec-b98e-df6d23265758 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:51.777123 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=27 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:40:51.783103 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-57513abd-3b68-4fec-b98e-df6d23265758 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:51.783758 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-57513abd-3b68-4fec-b98e-df6d23265758 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:51.784610 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-57513abd-3b68-4fec-b98e-df6d23265758 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:51.785051 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-57513abd-3b68-4fec-b98e-df6d23265758 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:51.912808 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.network.security_group_api [None req-57513abd-3b68-4fec-b98e-df6d23265758 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Removing security group 3a8b39ea-cbe1-4bb0-835c-4c7063fcc2a9 from port 7a899c90-0e7d-4a42-9984-b0e866be244e Jul 21 06:40:52.245334 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-57513abd-3b68-4fec-b98e-df6d23265758 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "POST /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/action" status: 202 len: 0 microversion: 2.1 time: 0.475716 Jul 21 06:40:52.247629 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 627/1242] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 06:40:51 2022] POST /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:40:52.259018 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-11200700-d62d-445a-879a-fa1e1f2c1688 req-25794000-97e8-4a23-a2f7-bef09fafd2fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac82ad70-7a1c-40c7-83eb-519088147c76", "tag": "7a899c90-0e7d-4a42-9984-b0e866be244e"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:52.264361 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:40:52.265487 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=15 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:40:52.270717 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-11200700-d62d-445a-879a-fa1e1f2c1688 req-25794000-97e8-4a23-a2f7-bef09fafd2fd service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:52.271313 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-11200700-d62d-445a-879a-fa1e1f2c1688 req-25794000-97e8-4a23-a2f7-bef09fafd2fd service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:52.291122 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-11200700-d62d-445a-879a-fa1e1f2c1688 req-25794000-97e8-4a23-a2f7-bef09fafd2fd service nova] Creating event network-changed:7a899c90-0e7d-4a42-9984-b0e866be244e for instance ac82ad70-7a1c-40c7-83eb-519088147c76 on hv-cinder-85031 Jul 21 06:40:52.297322 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-11200700-d62d-445a-879a-fa1e1f2c1688 req-25794000-97e8-4a23-a2f7-bef09fafd2fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045157 Jul 21 06:40:52.298600 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 616/1243] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:40:53.559451 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-b2fadba3-f13f-41a0-bc72-f92a7fa1a995 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:53.560007 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-b2fadba3-f13f-41a0-bc72-f92a7fa1a995 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:53.566075 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2fadba3-f13f-41a0-bc72-f92a7fa1a995 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:53.566625 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2fadba3-f13f-41a0-bc72-f92a7fa1a995 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:53.568008 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2fadba3-f13f-41a0-bc72-f92a7fa1a995 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:53.568507 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-b2fadba3-f13f-41a0-bc72-f92a7fa1a995 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:53.653583 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.objects.instance [None req-b2fadba3-f13f-41a0-bc72-f92a7fa1a995 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lazy-loading 'services' on Instance uuid ac82ad70-7a1c-40c7-83eb-519088147c76 {{(pid=117906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:40:53.725819 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-b2fadba3-f13f-41a0-bc72-f92a7fa1a995 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments/37e852d1-de3f-4d34-9a8c-3f2a6c7371b9" status: 202 len: 0 microversion: 2.1 time: 0.170498 Jul 21 06:40:53.726471 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 628/1244] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:40:53 2022] DELETE /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments/37e852d1-de3f-4d34-9a8c-3f2a6c7371b9 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:40:53.736675 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2e2935dd-b05e-4232-8bc3-541820493d8d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:53.737698 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2e2935dd-b05e-4232-8bc3-541820493d8d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:53.746406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2e2935dd-b05e-4232-8bc3-541820493d8d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:53.746856 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2e2935dd-b05e-4232-8bc3-541820493d8d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:53.747833 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2e2935dd-b05e-4232-8bc3-541820493d8d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:53.748271 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2e2935dd-b05e-4232-8bc3-541820493d8d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:53.778732 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2e2935dd-b05e-4232-8bc3-541820493d8d tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046303 Jul 21 06:40:53.779218 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 617/1245] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:40:53 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:40:54.318118 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-135b1091-249b-45da-86a9-535246aa09e9 req-714819d8-368c-4678-88d3-6d07274b7f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac82ad70-7a1c-40c7-83eb-519088147c76", "tag": "7a899c90-0e7d-4a42-9984-b0e866be244e"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:54.329139 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-135b1091-249b-45da-86a9-535246aa09e9 req-714819d8-368c-4678-88d3-6d07274b7f7c service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:54.329578 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-135b1091-249b-45da-86a9-535246aa09e9 req-714819d8-368c-4678-88d3-6d07274b7f7c service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:54.345395 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-135b1091-249b-45da-86a9-535246aa09e9 req-714819d8-368c-4678-88d3-6d07274b7f7c service nova] Creating event network-changed:7a899c90-0e7d-4a42-9984-b0e866be244e for instance ac82ad70-7a1c-40c7-83eb-519088147c76 on hv-cinder-85031 Jul 21 06:40:54.350450 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-135b1091-249b-45da-86a9-535246aa09e9 req-714819d8-368c-4678-88d3-6d07274b7f7c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037496 Jul 21 06:40:54.351574 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 629/1246] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:40:54.790598 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0ffabfd2-b3a2-45f9-adfd-82f33ba2a53a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:54.791720 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0ffabfd2-b3a2-45f9-adfd-82f33ba2a53a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:54.798946 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0ffabfd2-b3a2-45f9-adfd-82f33ba2a53a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:54.799396 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0ffabfd2-b3a2-45f9-adfd-82f33ba2a53a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:54.800172 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0ffabfd2-b3a2-45f9-adfd-82f33ba2a53a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:54.800624 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0ffabfd2-b3a2-45f9-adfd-82f33ba2a53a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:54.830486 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0ffabfd2-b3a2-45f9-adfd-82f33ba2a53a tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044339 Jul 21 06:40:54.830962 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 618/1247] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 06:40:54 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:40:54.842592 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-35449fc4-d97e-484a-a610-ffed5fedf29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:54.843238 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-35449fc4-d97e-484a-a610-ffed5fedf29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:54.850255 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-35449fc4-d97e-484a-a610-ffed5fedf29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:54.850705 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-35449fc4-d97e-484a-a610-ffed5fedf29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:54.851469 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-35449fc4-d97e-484a-a610-ffed5fedf29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:54.851910 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-35449fc4-d97e-484a-a610-ffed5fedf29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:54.928131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-35449fc4-d97e-484a-a610-ffed5fedf29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] HTTP exception thrown: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 is not attached to volume 37e852d1-de3f-4d34-9a8c-3f2a6c7371b9 Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-35449fc4-d97e-484a-a610-ffed5fedf29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Request method failure captured: Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: DELETE /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments/37e852d1-de3f-4d34-9a8c-3f2a6c7371b9 HTTP/1.1 Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PR5GJbfRBlmp67a84dM5zYcP-1oRe4NFSdeh5xbkmYjyrEp9j7pG9gltYxKTvgoT8npDchz1B2xk2-sg4RO2zQrIjgz3eYgW4qIwDHlUxRoZgMdGgUOWkY0NmsBllksNU_CLPtXMAQEPTIIguOltD8Fh-cyBDScjW6lMdbAwT0TMMg Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 9ba482e050244bc6a359090a616658ec Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-TestMinimumBasicScenario-265629958 Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:40:54.930893 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba482e050244bc6a359090a616658ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ba482e050244bc6a359090a616658ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba482e050244bc6a359090a616658ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ba482e050244bc6a359090a616658ec"}]}] Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-TestMinimumBasicScenario-265629958 Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 9ba482e050244bc6a359090a616658ec Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-TestMinimumBasicScenario-265629958 Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-TestMinimumBasicScenario-265629958-project Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 756c74602c4d4bafade01c406ffd6afc Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-TestMinimumBasicScenario-265629958-project Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:40:54.933131 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 is not attached to volume 37e852d1-de3f-4d34-9a8c-3f2a6c7371b9 Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'server_id': 'ac82ad70-7a1c-40c7-83eb-519088147c76', 'id': '37e852d1-de3f-4d34-9a8c-3f2a6c7371b9'} Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 37e852d1-de3f-4d34-9a8c-3f2a6c7371b9. Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:40:54.934599 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 is not attached to volume 37e852d1-de3f-4d34-9a8c-3f2a6c7371b9 Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 is not attached to volume 37e852d1-de3f-4d34-9a8c-3f2a6c7371b9 Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:54.936226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-35449fc4-d97e-484a-a610-ffed5fedf29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Returning 404 to user: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 is not attached to volume 37e852d1-de3f-4d34-9a8c-3f2a6c7371b9 {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:40:54.937442 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-35449fc4-d97e-484a-a610-ffed5fedf29c tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments/37e852d1-de3f-4d34-9a8c-3f2a6c7371b9" status: 404 len: 154 microversion: 2.1 time: 0.094662 Jul 21 06:40:54.937442 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 630/1248] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 06:40:54 2022] DELETE /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76/os-volume_attachments/37e852d1-de3f-4d34-9a8c-3f2a6c7371b9 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:40:56.068560 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-c9a8c5bd-6919-469c-aed3-2986bf3a4846 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:56.069060 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c9a8c5bd-6919-469c-aed3-2986bf3a4846 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:56.075406 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c9a8c5bd-6919-469c-aed3-2986bf3a4846 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:56.075856 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c9a8c5bd-6919-469c-aed3-2986bf3a4846 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:56.076611 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c9a8c5bd-6919-469c-aed3-2986bf3a4846 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:56.077044 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-c9a8c5bd-6919-469c-aed3-2986bf3a4846 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:56.102547 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-c9a8c5bd-6919-469c-aed3-2986bf3a4846 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Going to try to terminate instance {{(pid=117905) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:40:56.177192 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-c9a8c5bd-6919-469c-aed3-2986bf3a4846 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 204 len: 0 microversion: 2.1 time: 0.112118 Jul 21 06:40:56.177934 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 619/1249] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:40:56 2022] DELETE /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:40:56.187081 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-982d014a-8977-4a64-aa66-915217a84809 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:56.187857 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-982d014a-8977-4a64-aa66-915217a84809 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:56.195190 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-982d014a-8977-4a64-aa66-915217a84809 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:56.195641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-982d014a-8977-4a64-aa66-915217a84809 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:56.196408 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-982d014a-8977-4a64-aa66-915217a84809 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:56.196844 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-982d014a-8977-4a64-aa66-915217a84809 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:56.328205 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-982d014a-8977-4a64-aa66-915217a84809 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:56.335641 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-982d014a-8977-4a64-aa66-915217a84809 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1556 microversion: 2.1 time: 0.153300 Jul 21 06:40:56.336213 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 631/1250] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:56 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:57.353823 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-54b4986b-0c0b-49a4-a4c2-ddeafc38c7aa tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:57.354477 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-54b4986b-0c0b-49a4-a4c2-ddeafc38c7aa tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:57.360904 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-54b4986b-0c0b-49a4-a4c2-ddeafc38c7aa tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:57.361390 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-54b4986b-0c0b-49a4-a4c2-ddeafc38c7aa tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:57.362186 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-54b4986b-0c0b-49a4-a4c2-ddeafc38c7aa tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:57.362628 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-54b4986b-0c0b-49a4-a4c2-ddeafc38c7aa tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:57.492787 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-54b4986b-0c0b-49a4-a4c2-ddeafc38c7aa tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:57.500420 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-54b4986b-0c0b-49a4-a4c2-ddeafc38c7aa tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1556 microversion: 2.1 time: 0.150930 Jul 21 06:40:57.500987 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 620/1251] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:57 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:40:58.496790 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-5ddc2107-ff05-4833-a813-973e5e4fec9a req-04c59b2e-8637-4f76-bc6a-df9e0282337b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac82ad70-7a1c-40c7-83eb-519088147c76", "name": "network-vif-deleted", "tag": "7a899c90-0e7d-4a42-9984-b0e866be244e"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:40:58.507609 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-5ddc2107-ff05-4833-a813-973e5e4fec9a req-04c59b2e-8637-4f76-bc6a-df9e0282337b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:58.508086 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-5ddc2107-ff05-4833-a813-973e5e4fec9a req-04c59b2e-8637-4f76-bc6a-df9e0282337b service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:58.518112 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-41448818-8b86-4b78-88fd-b4d0c5f82abb tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:58.518821 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-41448818-8b86-4b78-88fd-b4d0c5f82abb tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:58.519236 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-5ddc2107-ff05-4833-a813-973e5e4fec9a req-04c59b2e-8637-4f76-bc6a-df9e0282337b service nova] Creating event network-vif-deleted:7a899c90-0e7d-4a42-9984-b0e866be244e for instance ac82ad70-7a1c-40c7-83eb-519088147c76 on hv-cinder-85031 Jul 21 06:40:58.525516 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-5ddc2107-ff05-4833-a813-973e5e4fec9a req-04c59b2e-8637-4f76-bc6a-df9e0282337b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032412 Jul 21 06:40:58.526518 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 632/1252] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:40:58.530370 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41448818-8b86-4b78-88fd-b4d0c5f82abb tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:58.531087 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41448818-8b86-4b78-88fd-b4d0c5f82abb tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:58.532485 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41448818-8b86-4b78-88fd-b4d0c5f82abb tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:58.532925 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-41448818-8b86-4b78-88fd-b4d0c5f82abb tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:58.601850 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-41448818-8b86-4b78-88fd-b4d0c5f82abb tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756c74602c4d4bafade01c406ffd6afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba482e050244bc6a359090a616658ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:40:58.609510 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-41448818-8b86-4b78-88fd-b4d0c5f82abb tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 200 len: 1344 microversion: 2.1 time: 0.095387 Jul 21 06:40:58.610096 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 621/1253] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:58 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 1344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:40:59.627670 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4ac144d5-01a1-4d37-927a-cc1e6f7a69c1 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:59.628408 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-4ac144d5-01a1-4d37-927a-cc1e6f7a69c1 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] [instance: ac82ad70-7a1c-40c7-83eb-519088147c76] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:40:59.634704 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4ac144d5-01a1-4d37-927a-cc1e6f7a69c1 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:59.635150 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4ac144d5-01a1-4d37-927a-cc1e6f7a69c1 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:59.635917 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4ac144d5-01a1-4d37-927a-cc1e6f7a69c1 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:40:59.636356 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-4ac144d5-01a1-4d37-927a-cc1e6f7a69c1 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:40:59.649265 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-4ac144d5-01a1-4d37-927a-cc1e6f7a69c1 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] HTTP exception thrown: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 could not be found. Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4ac144d5-01a1-4d37-927a-cc1e6f7a69c1 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Request method failure captured: Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 HTTP/1.1 Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PR5GJbfRBlmp67a84dM5zYcP-1oRe4NFSdeh5xbkmYjyrEp9j7pG9gltYxKTvgoT8npDchz1B2xk2-sg4RO2zQrIjgz3eYgW4qIwDHlUxRoZgMdGgUOWkY0NmsBllksNU_CLPtXMAQEPTIIguOltD8Fh-cyBDScjW6lMdbAwT0TMMg Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: 9ba482e050244bc6a359090a616658ec Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-TestMinimumBasicScenario-265629958 Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:40:59.650899 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba482e050244bc6a359090a616658ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9ba482e050244bc6a359090a616658ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9ba482e050244bc6a359090a616658ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9ba482e050244bc6a359090a616658ec"}]}] Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-TestMinimumBasicScenario-265629958 Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: 9ba482e050244bc6a359090a616658ec Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-TestMinimumBasicScenario-265629958 Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-TestMinimumBasicScenario-265629958-project Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 756c74602c4d4bafade01c406ffd6afc Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-TestMinimumBasicScenario-265629958-project Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 could not be found. Jul 21 06:40:59.652535 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': 'ac82ad70-7a1c-40c7-83eb-519088147c76'} Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 could not be found. Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:40:59.653563 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 could not be found. Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 could not be found. Jul 21 06:40:59.655168 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:40:59.656559 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-4ac144d5-01a1-4d37-927a-cc1e6f7a69c1 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Returning 404 to user: Instance ac82ad70-7a1c-40c7-83eb-519088147c76 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:40:59.656559 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-4ac144d5-01a1-4d37-927a-cc1e6f7a69c1 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76" status: 404 len: 111 microversion: 2.1 time: 0.029331 Jul 21 06:40:59.656559 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 633/1254] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:40:59 2022] GET /compute/v2.1/servers/ac82ad70-7a1c-40c7-83eb-519088147c76 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:40:59.661602 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a3a12989-242f-4dc3-adc2-301548441546 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] Calling method '.version_select at 0x7f9327db3ca0>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:40:59.678904 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a3a12989-242f-4dc3-adc2-301548441546 tempest-TestMinimumBasicScenario-265629958 tempest-TestMinimumBasicScenario-265629958-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1781095075" status: 202 len: 0 microversion: 2.1 time: 0.021792 Jul 21 06:40:59.679459 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 622/1255] 10.222.0.42 () {58 vars in 1271 bytes} [Thu Jul 21 06:40:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1781095075 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:41:36.160226 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-aadaa5d4-0e9b-451b-a0a6-636297c4e7fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:41:36.161828 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-aadaa5d4-0e9b-451b-a0a6-636297c4e7fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:41:36.164899 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:41:36.166151 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG dbcounter [-] [117905] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:41:36.169876 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_api:SELECT=14 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:41:36.171011 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG dbcounter [-] [117906] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=117906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:41:36.175772 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aadaa5d4-0e9b-451b-a0a6-636297c4e7fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:36.176617 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aadaa5d4-0e9b-451b-a0a6-636297c4e7fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:36.177692 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aadaa5d4-0e9b-451b-a0a6-636297c4e7fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:36.178358 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-aadaa5d4-0e9b-451b-a0a6-636297c4e7fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:36.209831 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-aadaa5d4-0e9b-451b-a0a6-636297c4e7fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Going to try to terminate instance {{(pid=117906) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:41:36.296495 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-aadaa5d4-0e9b-451b-a0a6-636297c4e7fc tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 204 len: 0 microversion: 2.1 time: 0.140106 Jul 21 06:41:36.298628 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 634/1256] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 06:41:36 2022] DELETE /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:41:36.310462 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-dbdab941-fa85-4499-9bb4-c552e6ba6157 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:41:36.311214 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-dbdab941-fa85-4499-9bb4-c552e6ba6157 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:41:36.318268 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dbdab941-fa85-4499-9bb4-c552e6ba6157 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:36.318707 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dbdab941-fa85-4499-9bb4-c552e6ba6157 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:36.319582 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dbdab941-fa85-4499-9bb4-c552e6ba6157 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:36.320021 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-dbdab941-fa85-4499-9bb4-c552e6ba6157 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:36.377420 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [req-27f72b58-0866-4199-9bc4-bac57f3e7953 req-64396a63-c557-4d0b-a0de-de1c3a25671e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d4bc012-5129-4651-97ea-340f735e5e53", "tag": "a91746a4-9dc2-4a55-966c-ce5ac2be362d"}]} {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:41:36.400183 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-27f72b58-0866-4199-9bc4-bac57f3e7953 req-64396a63-c557-4d0b-a0de-de1c3a25671e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:36.400935 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [req-27f72b58-0866-4199-9bc4-bac57f3e7953 req-64396a63-c557-4d0b-a0de-de1c3a25671e service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:36.415009 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.compute.server_external_events [req-27f72b58-0866-4199-9bc4-bac57f3e7953 req-64396a63-c557-4d0b-a0de-de1c3a25671e service nova] Creating event network-changed:a91746a4-9dc2-4a55-966c-ce5ac2be362d for instance 1d4bc012-5129-4651-97ea-340f735e5e53 on hv-cinder-85031 Jul 21 06:41:36.420886 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [req-27f72b58-0866-4199-9bc4-bac57f3e7953 req-64396a63-c557-4d0b-a0de-de1c3a25671e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258157 Jul 21 06:41:36.421922 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 623/1257] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:41:36.476687 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.policy [None req-dbdab941-fa85-4499-9bb4-c552e6ba6157 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117906) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:41:36.484147 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-dbdab941-fa85-4499-9bb4-c552e6ba6157 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.181358 Jul 21 06:41:36.484928 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 635/1258] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:41:36 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:41:37.502316 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-2a2720c8-0f27-423d-acab-1589a688a99c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:41:37.503029 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-2a2720c8-0f27-423d-acab-1589a688a99c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:41:37.510662 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2a2720c8-0f27-423d-acab-1589a688a99c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:37.511112 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2a2720c8-0f27-423d-acab-1589a688a99c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:37.511892 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2a2720c8-0f27-423d-acab-1589a688a99c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:37.512330 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-2a2720c8-0f27-423d-acab-1589a688a99c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:37.643911 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-2a2720c8-0f27-423d-acab-1589a688a99c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:41:37.651647 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-2a2720c8-0f27-423d-acab-1589a688a99c tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1566 microversion: 2.1 time: 0.153476 Jul 21 06:41:37.652233 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 624/1259] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:41:37 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:41:38.610856 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [req-9d5df10c-dddc-4abc-acb5-918dabf3fc36 req-74d3f054-085d-4723-ae7d-8ff5f94cdc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4bc012-5129-4651-97ea-340f735e5e53", "name": "network-vif-deleted", "tag": "a91746a4-9dc2-4a55-966c-ce5ac2be362d"}]} {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:41:38.621885 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-9d5df10c-dddc-4abc-acb5-918dabf3fc36 req-74d3f054-085d-4723-ae7d-8ff5f94cdc61 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:38.622359 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [req-9d5df10c-dddc-4abc-acb5-918dabf3fc36 req-74d3f054-085d-4723-ae7d-8ff5f94cdc61 service nova] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:38.635015 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.compute.server_external_events [req-9d5df10c-dddc-4abc-acb5-918dabf3fc36 req-74d3f054-085d-4723-ae7d-8ff5f94cdc61 service nova] Creating event network-vif-deleted:a91746a4-9dc2-4a55-966c-ce5ac2be362d for instance 1d4bc012-5129-4651-97ea-340f735e5e53 on hv-cinder-85031 Jul 21 06:41:38.640312 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [req-9d5df10c-dddc-4abc-acb5-918dabf3fc36 req-74d3f054-085d-4723-ae7d-8ff5f94cdc61 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033201 Jul 21 06:41:38.640937 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 636/1260] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 06:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:41:38.668717 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-0d682e87-53ac-43fa-bc1f-01c808ce5b87 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:41:38.669339 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.compute.api [None req-0d682e87-53ac-43fa-bc1f-01c808ce5b87 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117905) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:41:38.676064 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0d682e87-53ac-43fa-bc1f-01c808ce5b87 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:38.676518 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0d682e87-53ac-43fa-bc1f-01c808ce5b87 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:38.677300 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0d682e87-53ac-43fa-bc1f-01c808ce5b87 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:38.677741 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG oslo_concurrency.lockutils [None req-0d682e87-53ac-43fa-bc1f-01c808ce5b87 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:38.745688 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.policy [None req-0d682e87-53ac-43fa-bc1f-01c808ce5b87 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f951e37e60145aba97bcd1ff8aad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3a6e00103d49038260d28a680a9c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117905) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:41:38.753289 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-0d682e87-53ac-43fa-bc1f-01c808ce5b87 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 200 len: 1219 microversion: 2.1 time: 0.088458 Jul 21 06:41:38.753854 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 625/1261] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:41:38 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:41:39.771579 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-968da46d-b2fd-4bc5-9fa7-38b6fea1764d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '>' {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:41:39.772834 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.compute.api [None req-968da46d-b2fd-4bc5-9fa7-38b6fea1764d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] [instance: 1d4bc012-5129-4651-97ea-340f735e5e53] Fetching instance by UUID {{(pid=117906) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:41:39.779163 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-968da46d-b2fd-4bc5-9fa7-38b6fea1764d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:39.779619 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-968da46d-b2fd-4bc5-9fa7-38b6fea1764d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:39.780383 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-968da46d-b2fd-4bc5-9fa7-38b6fea1764d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:41:39.780823 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG oslo_concurrency.lockutils [None req-968da46d-b2fd-4bc5-9fa7-38b6fea1764d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Lock "6c4473db-2c5c-4a23-b88a-a9d1173a3dee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:41:39.794919 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.wsgi [None req-968da46d-b2fd-4bc5-9fa7-38b6fea1764d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] HTTP exception thrown: Instance 1d4bc012-5129-4651-97ea-340f735e5e53 could not be found. Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-968da46d-b2fd-4bc5-9fa7-38b6fea1764d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Request method failure captured: Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: request: GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 HTTP/1.1 Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept: application/json Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Accept-Encoding: identity Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Connection: close Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Length: 0 Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Content-Type: application/json Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Host: 10.222.0.42 Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Openstack-System-Scope: None Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: User-Agent: python-urllib3/1.26.9 Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Auth-Token: gAAAAABi2PQCyTVLOJwN9YJqptDVIIEqfmdpJsIp0uQx6vHD80CsNUE4pH3Lg7lQwNkhYAhYDxYEHGair21RCmB7z8r45QFAtHLcKtMZa6UhrkcXpsVbOKiAyjjAjgGOIadH4mkNvWgDk3HyKPqhLEeV-zrahxJKKhhUIpvhrT-h8cL5qFhkg9o Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Id: None Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Domain-Name: None Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Identity-Status: Confirmed Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Is-Admin-Project: True Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Id: default Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Domain-Name: Default Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Id: fd3a6e00103d49038260d28a680a9c56 Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Project-Name: tempest-TestShelveInstance-2145362309 Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Role: reader,member Jul 21 06:41:39.796539 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Roles: reader,member Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fd3a6e00103d49038260d28a680a9c56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fd3a6e00103d49038260d28a680a9c56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fd3a6e00103d49038260d28a680a9c56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fd3a6e00103d49038260d28a680a9c56"}]}] Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant: tempest-TestShelveInstance-2145362309 Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Id: fd3a6e00103d49038260d28a680a9c56 Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-Tenant-Name: tempest-TestShelveInstance-2145362309 Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User: tempest-TestShelveInstance-2145362309-project Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Id: default Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Domain-Name: Default Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Id: 0f951e37e60145aba97bcd1ff8aad260 Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: X-User-Name: tempest-TestShelveInstance-2145362309-project Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: method: > Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: exception: Instance 1d4bc012-5129-4651-97ea-340f735e5e53 could not be found. Jul 21 06:41:39.798344 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: action_args: {'id': '1d4bc012-5129-4651-97ea-340f735e5e53'} Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: {{(pid=117906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d4bc012-5129-4651-97ea-340f735e5e53 could not be found. Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:41:39.799528 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d4bc012-5129-4651-97ea-340f735e5e53 could not be found. Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d4bc012-5129-4651-97ea-340f735e5e53 could not be found. Jul 21 06:41:39.801184 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: ERROR nova.api.openstack.wsgi Jul 21 06:41:39.802942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: DEBUG nova.api.openstack.wsgi [None req-968da46d-b2fd-4bc5-9fa7-38b6fea1764d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Returning 404 to user: Instance 1d4bc012-5129-4651-97ea-340f735e5e53 could not be found. {{(pid=117906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:41:39.802942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO nova.api.openstack.requestlog [None req-968da46d-b2fd-4bc5-9fa7-38b6fea1764d tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53" status: 404 len: 111 microversion: 2.1 time: 0.031021 Jul 21 06:41:39.802942 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: [pid: 117906|app: 0|req: 637/1262] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 06:41:39 2022] GET /compute/v2.1/servers/1d4bc012-5129-4651-97ea-340f735e5e53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:41:39.958334 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: DEBUG nova.api.openstack.wsgi [None req-a5d71d83-94bb-4ffd-a69a-8eb1c72f6e14 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] Calling method '.version_select at 0x7f9327bfcee0>' {{(pid=117905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:41:39.976025 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO nova.api.openstack.requestlog [None req-a5d71d83-94bb-4ffd-a69a-8eb1c72f6e14 tempest-TestShelveInstance-2145362309 tempest-TestShelveInstance-2145362309-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1626767190" status: 202 len: 0 microversion: 2.1 time: 0.021385 Jul 21 06:41:39.976558 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: [pid: 117905|app: 0|req: 626/1263] 10.222.0.42 () {58 vars in 1253 bytes} [Thu Jul 21 06:41:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1626767190 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:42:15.331302 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:42:15.331874 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Thu Jul 21 06:42:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:43:59.071258 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:43:59.071839 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Thu Jul 21 06:43:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:44:21.327525 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:44:21.328113 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Thu Jul 21 06:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:44:23.105417 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:44:23.105877 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Thu Jul 21 06:44:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:45:27.366479 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:45:27.367074 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Thu Jul 21 06:45:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:45:35.341601 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:45:35.342285 dv-cinder-850318-3-iscsi devstack@n-api.service[117906]: Thu Jul 21 06:45:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:47:07.064405 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:47:07.064895 dv-cinder-850318-3-iscsi devstack@n-api.service[117905]: Thu Jul 21 06:47:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!